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ABSTRACT 


This  thesis  deals  with  localization  results  for  the  eigen¬ 
values,  their  sums  and  products,  the  singular  values  and  the  condition 
number  of  a  matrix.  Part  I  of  the  thesis  is  in  tabular  form.  Here  we 
give  localization  results  which  involve  certain  pieces  of  given  data. 

For  example,  we  attempt  to  answer  the  following  sample  question: 

"Given  the  data  tr  A  ,  tr  A  and  that  the  eigenvalues  of  the  matrix  A 
are  real,  what  more  can  be  said  about  the  localization  of  the  eigen¬ 
values  of  A  ?"  The  different  data  used  is  given  in  the  Table  of  Con¬ 
tents.  We  answer  these  questions  only  partially,  i.e.  we  do  not  include 
all  known  results.  However,  it  is  a  step  in  that  direction.  In  Part  II 
we  discuss  some  specialized  topics  viz.,  spectral  radius,  spread,  Gersch- 
gorin  disks,  singular  values  and  the  condition  number.  Both  parts  of  the 
thesis  also  include  some  interesting  theorems  about  matrices  and  eigen¬ 
values. 
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PREFACE 


This  thesis  consists  of  two  parts.  Part  I  is  arranged  in  a 
tabular  form.  It  consists  of  chapters  one  through  thirteen  which  corres 
pond  to  thirteen  different  characteristics  or  properties  of  a  matrix, 

■k 

e.g.,  tr  AA  ,  Hermitian,  positive  definite  etc.  Each  chapter,  say 

chapter  t,  consists  of  at  most  2^""*  sections  arranged  in  lexicographic 

order.  Further,  each  section  contains  localization  results  involving  a 

subset  of  t  characteristics  of  the  first  t  chapters.  For  example, 

? 

if  tr  A  and  tr  A  of  a  matrix  with  real  eigenvalues  are  given,  then 
these  pieces  of  information  correspond  to  chapters  1,  3  and  8,  respec¬ 
tively  and  localization  results  are  given  in  section  8:3.1.  If  for  cer¬ 
tain  pieces  of  data  no  new  results  are  available,  we  skip  that  section. 
This  explains  the  existence  of  gaps  between  sections  in  the  table  of 
contents. 


In  addition  to  localization  results,  the  first  section  of  each 
chapter  also  contains  some  basic  definitions  and/or  some  useful  results 
Each  subsequent  section  has  results  only  under  the  headings  (a)  through 
(h),  whenever  available.  Each  of  these  headings  contains  some  specific 
results  as  indicated  below: 

(a)  For  the  spectral  radius  or  the  largest  eigenvalue. 

(b)  For  the  smallest  eigenvalue. 

(c)  For  the  kth  eigenvalue. 

(d)  For  the  spread. 

(e)  For  sum  of  eigenvalues. 

(f)  For  product  of  eigenvalues. 
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(g)  For  singular  values. 

(h)  For  the  condition  number. 


In  Part  II  we  discuss  some  specialized  topics,  namely,  spectral 
radius,  spread,  Gerschgorin  disks,  singular  values  and  the  condition 
number.  In  each  chapter  we  give  some  theorems  and  localization  results. 
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THE  NUMBERING  SYSTEM  AND  SYMBOLS 


Within  the  text  of  a  chapter  a  reference  to  a  section  in  that 
chapter  will  only  give  the  number  of  the  section.  A  reference  to  a  sec¬ 
tion  in  some  other  chapter,  but  in  the  same  part,  will  be  preceded  by  the 
number  of  the  chapter  and  will  be  separated  by  a  colon.  In  case  a  section 
of  a  different  part  is  referenced,  the  chapter  number  will  be  preceded  by 
the  part  number  and  will  be  separated  by  a  colon.  For  example,  if  we  wish 
to  refer  to  section  2  of  chapter  4  of  Part  II  in  Part  I,  we  write  "11:4:2", 
while  referring  to  it  in  a  different  chapter  of  Part  II  we  write  "4:2". 
Equations  and  theorems  are  referred  to  by  the  section  number  followed  by 
the  equation  number  or  the  theorem  number  in  parentheses.  Thus  if  we 
refer  to  Theorem  1  of  Section  1  and  Chapter  4  of  Part  II,  in  Part  I,  we 
write  'Theorem  11:4:1  (l)1,  while  referring  to  it  in  a  different  chapter 
of  Part  II  we  write  "Theorem  4:1  (1)".  External  references  are  always 
given  in  closed  brackets.  In  case  a  book  is  referred  to,  the  reference 
number  is  followed  by  the  appropriate  page  number. 

In  addition,  we  shall  use  the  following  symbols: 

(1)  I  -  factorial 

(2)  i  -  /T  ' 

(3)  | u  |  -  absolute  value  of  the  complex  number  u  . 

(4)  Re(u)  -  real  part  of  the  complex  number  u  . 

(5)  Im(u)  -  imaginary  part  of  the  complex  number  u  . 

(6)  (fm  -  set  of  all  complex  m*l  vectors. 

(7)  e.  -  a  vector  with  1  as  the  ith  component  and  zeros  elsewhere. 

(8)  I  -  the  identity  matrix  of  order  n  . 

(9)  A1  -  transpose  of  A  . 
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(10)  A  -  conjugate  transpose  of  A  . 

(11)  B  -  j  (A+A*)  . 

(12)  C  -  2J  ( A-A* )  . 

(13)  diag(x-|  jX^,***  ,xn)  -  a  diagonal  matrix  with  x..  as  the  ith 

diagonal  element. 

(14)  A  >  (>)  0  -  elements  of  A  are  positive  (nonnegative). 

(15)  (x,y)  -  x  y  ,  the  inner  product  of  x  and  y  . 

(16)  ||x||2  -  xx  . 

(17)  x  <  y  -  y  majorizes  x  . 

(18)  x  <w  y  -  y  majorizes  x  ,  weakly. 

(19)  X.  -  an  eigenvalue  of  A  . 

(20)  y.  -  an  eigenvalue  of  B  . 

(21)  v.j  -  an  eigenvalue  of  C  . 

(22)  o-  -  a  singular  value  of  A  . 

(23)  tr  A  -  trace  of  A  . 

(24)  sp(A)  -  max  |X.-X.|  ,  the  spread  of  A  . 

i,j  1  J 


(25) 

spR(A) 

-  max  (Re(X. )  -  Re(X  .) )  . 
i,j  1  J 

(26) 

< 

l — i 

CL 

LO 

-  max  ( Im(X . )  -  Im(X .) )  . 
i  ,5  1  J 

(27) 

det  A  - 

determinant  of  A  . 

(28) 

c(A)  - 

the  condition  number  of  A  . 

(29) 

P  ( A)  - 

spectral  radius  of  A  . 

(30) 

p(x)  - 

(x,Ax)  /  ( x , x )  . 
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INTRODUCTION 


Given  a  complex  matrix  A  =  (a.  .)  of  order  n  ,  a  complex 

*  J 

scalar  X  is  called  an  eigenvalue  of  A  if  there  exists  a  non-zero 
vector  x  such  that  (A-XI)x  =  0  .  Thus  X  is  an  eigenvalue  of  A 
if  and  only  if  det(A-XI)  ,  called  the  characteristic  polynomial  of  A, 
is  zero.  Since  the  degree  of  the  characteristic  polynomial  of  A  is 
n  ,  we  conclude  that  a  matrix  of  order  n  has  exactly,  counting  multi¬ 
plicities,  n  eigenvalues.  We  shall  always  denote  the  eigenvalues  of 
A  by  Xk  ,  k  =  1 ,2,*** ,n  .  We  also  note  that  the  positive  square  roots 
of  the  eigenvalues  of  the  matrix  AA  ,  where  A  is  the  conjugate 
transpose  of  A  ,  are  called  the  singular  values  of  A  . 

In  many  applications  the  approximate  location  of  the  eigenval¬ 
ues  of  a  matrix  suffices  and,  also,  because  of  the  effort  involved  in 
computing  the  eigenvalues  of  A  ,  it  becomes  expedient  to  approximate 
them  by  some  means.  For  example,  in  many  iterative  methods  for  solving 
a  system  of  linear  equations  the  method  converges  if  the  spectral  radius 

of  a  certain  matrix  is  less  than  one.  In  the  theory  of  differential  equa- 

dx 

tions  the  linear  homogenous  system  •—  =  Ax  is  said  to  have  a  asymtotical ly 
stable  solution  if  all  the  eigenvalues  of  A  have  negative  real  parts. 
Further,  the  condition  number,  c(A)  =  | |A| |  ||A”^||  ,  where  ||*|l  1S 
a  matrix  norm,  is  useful  for  determining  whether  or  not  the  system  of 
linear  equations  Ax  =  b  is  wel 1 -condi tioned.  In  optimization  the  condi¬ 
tion  number  of  the  Hessian  of  a  certain  matrix  at  the  solution  provides  a 
measure  of  the  sensitivity  of  the  optimal  solution.  In  case  of  the  2- 
norm  or  the  spectral  norm,  when  A  is  nonsingular,  c ( A)  =  a-j  /  an  ,  the 
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ratio  of  the  largest  and  smallest  singular  values.  Thus,  an  estimate  for 
a-|  and  of  a  nonsingular  matrix  provides  an  estimate  for  c(A)  . 
Further,  as  we  shall  see  in  Chapter  5  of  Part  II,  for  certain  matrix  norms 
we  get  max  |A.|  /  min|A.|  £  c(A)  .  Therefore,  bounds  for  max  |A.|  and 

i  l  i 

min  | A . |  can  be  used  for  estimating  c ( A)  . 
i 

In  this  thesis  we  shall  be  concerned  with  the  localization  of 
the  eigenvalues,  their  sums  and  products,  the  spectral  radius,  the  spread, 
the  singular  values  and  the  condition  number  of  a  matrix. 


Localization  results  abound  in  the  literature.  Marcus  and  Mine 
in  their  book  (see  Chapter  III  of  [31])  give  a  brief  history  of  these 
results.  For  example,  in  1909,  Issai  Schur  proved  the  following: 


l  lx.  I2  <  tr  AA*  ,  (1) 

1 

I  Re(A.)2  <  tr  B2  =  1  (tr  AA*  +  Re(tr  A2))  ,  (2) 

i 

l  Im(A.. )2  <  tr  C2  =  |  (tr  AA  -  Re(tr  A2))  ,  (3) 

with  equality  if  and  only  if  A  is  normal.  In  1946,  Alfred  Brauer  proved 
that,  for  an  arbitrary  matrix  A  , 

max  | A.  |  <_  min  (R,C)  ,  (4) 

4  1 


where 


R  =  max  R.  and 
•  1 


C  =  max  C. 

l 


However,  this  result  was  anticipated  by  Oskar  Perron  in  1933  and  also 
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follows  from  Gerschgorin's  Theorem,  which  was  proved  in  1931  (see  [31, 
pg.  145]).  Gerschgorin  proved  that  all  the  eigenvalues  of  a  matrix  A 
lie  in  the  disks 
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|z  -  aRk|  <  Rk  -  |akkl  >  k  1 ,2,* • •  ,n  .  (5) 

The  proof  of  the  above  follows  readily  from  the  Levy-Despl anques  Theorem, 
proved  in  1887.  Another  well-known  result  is  the  Frobenius  Theorem  for 
nonnegative  matrices.  It  states  that  if  A  is  nonnegative,  i.e. 
for  all  i  and  j  ,  then 

min  R.  £  max  |X. |  £  max  R.  .  (6) 

i  i  i 

The  theory  of  nonnegative  matrices,  originated  by  Perron  and  Frobenious, 
has  proved  to  be  very  useful  (see  e.g.  [51]  and  [59]). 


More  recently  Henry  Wolkowicz  and  George  P.H.  Styan  obtained 
several  localization  results  using  traces  (see  [63]  and  [64]).  For 
example,  they  showed 


W-s.(^)1/2<|Xj<(^)1/Z  +  sa(i^)1/2  .  k=l,2,...,n 


a  n-k+1  —  1  k 1  —  n 


2  *  i  1 2 

where,  m  =  tr  A  /  n  and  so  =  tr  AA  /  n  -  m 

a 


(7) 


All  the  above  mentioned  results  are  included  in  Part  I.  Also 
included  are  many  other  results.  For  example,  in  Chapter  2  of  Part  I  we 
include  the  inequalities: 


k  k 
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k  =  1 ,2,«««  ,n 


a. 
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where  d.  's  are  the  moduli  of  the  diagonal  elements,  arranged  in  decreas¬ 
ing  order.  Chapter  5  includes  improved  versions  of  inequalities  (1),  (2) 
and  (3).  In  Chapter  6  we  give  many  localization  results  involving  row 
and  column  sums,  including  inequalities  (4)  and  (5).  Also  included  are 
several  conditions  which  ensure  the  nonsingulari ty  of  a  matrix.  For  exampl 
it  is  shown  that,  det  A  f  0  if 

I  a . . I  >  R .  -  la.. I  ,  i  =  1 , 2 ,  • • • ,  n 
1  n  1  i  1  n  1 

In  Chapter  7  bounds  for  eigenvalues  are  derived  by  means  of  the  arithmetic- 
geometric  mean  inequality.  For  example,  we  prove  that 


det  A|^  <_  | Xn  |  ^  <_  tr  AA  -  (n-1 )  |  det  A| 


n-1  >n-l 


*/ 

tr  AA 


In  Chapter  8  we  give  necessary  and  sufficient  conditions  for  a  matrix  to 
have  real  eigenvalues.  Also  included  are  several  eigenvalue  bounds  invol- 


2 

ving  tr  A  and  tr  A  .  For  example, 


k  =  1 ,2 , • • •  ,n 


where 


2  2  2 
m  =  tr  A  /  n  and  s  =  tr  A  /  n  -  m 


and 


>  A 


n 


Chapter  10  deals  with  nonnegative  matrices.  Here,  we  first  classify  the 
nonnegative  matrices  and  then  state  their  interesting  spectral  properties. 
Chapters  11,  12  and  13  deal  with  a  special  class  of  matrices,  the  normal 


•.  fi  * .  :>  ‘  r  ,  f.  k  •  c  •  &  rv  *»  ‘ v nil 


A  *T»  Sli 


ft 


' 


5 


matrices.  Such  matrices  are  always  unitarily  diagonal izable.  Also,  for  a 
normal  matrix  the  moduli  of  the  eigenvalues,  |A.|  ,  i  =  l,2,**#,n  ,  are 
its  singular  values.  Thus  all  the  results  for  singular  values  in  previous 
chapters  hold  for  the  eigenvalues. 

In  Part  II  we  consider  some  specialized  topics.  In  Chapter  1  we 
discuss  the  spectral  radius.  In  particular  we  show  that  for  certain  matrix 
norms , 

max  |  A.  |  =  p ( A)  <_  |  |  A  |  | 

•  I 

i 

Also  included  are  some  results  which  improve  upon  inequality  (6)  above.  In 
Chapter  2  we  give  results  for  the  spread  of  a  matrix.  In  Chapter  3  we 
briefly  discuss  Gerschgorin 1  s  disks.  In  Chapter  4  we  give  several  inequali¬ 
ties  relating  the  singular  values  with  the  eigenvalues,  real  singular 
values  and  imaginary  singular  values.  For  example, 

k  k 

II  | A .  |  <_  n  a-  ,  k  =  1 ,2,*«» ,n  , 
i=l  1  i=l  1 


and 


uk±°k 


k  =  1 ,2,»« •  ,n  , 


k  =  1 ,2,«°*  ,n  , 


where,  ,  y^  and  are  the  singular  values,  real  singular  values 
and  imaginary  singular  values  of  A  ,  respectively.  Also  included  are 
bounds  for  the  singular  values  themselves.  For  example. 


■ 

:9V<*c  6Vf  ) 


■ 
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•j  u  o 

max  —III  a  .  ,  |  <  a,  , 
l<;s,t<n-l  /It  j=l  i=l  1J  1 


a  <  min  R.  =  min  y  la. 

n  -  i  1  i  i  1 


In  Chapter  5  we  briefly  discuss  the  condition  number. 

Now  we  shall  give  some  definitions  which  are  assumed  throughout 

the  thesis.  First,  let  A  =  (a..)  be  an  mxn  complex  matrix.  Unless 

i  J 

otherwise  stated  we  shall  always  assume  that  m  =  n  ,  that  is  A  is  a 

square  matrix  of  order  n  .  Let  X.  ,  i  =  l,2,»«*,n  be  the  eigenvalues 

of  A  .  Generally,  we  shall  assume  that  X.  ,  i  =  l,2,***,n  are  ordered 

as  |X,  |  >  |X„ |  >  •••  >  | X  |  ,  if  complex  and  as  X1  >  A0  >  •••  >  A  , 

i  ii  —  i  2 1  —  —  1  n 1  r  1—2—  —  n 

if  real . 


Definition  1:  A  matrix  P  is  called  a  permutation  matrix  if  each  row 
and  each  column  of  P  has  some  one  entry  unity  and  all  others  zero. 

□ 

Definition  2:  For  n  >_  2  a  complex  matrix  A  of  order  n  is  called 
reducible  if  there  exists  a  permutation  matrix  P  such  that 

PAP'  =  F)  , 

\0  E/ 

where  D  and  E  are  matrices  of  order  r  <  n  and  s  respectively 
such  that  r+s  =  n  .  □ 

Definition  3:  If  a  matrix  A  is  not  reducible  then  it  is  called  irreduc¬ 


ible. 


□ 


. 


Definition  4:  A  matrix  A  is  called  skew-Hermi tian  if  A  =  -A  . 


□ 


Definition  5:  Given  a  matrix  A  ,  it  is  called  a  scalar  matrix,  if 
A  =  al  ,  for  some  complex  number  a  .  n 

Definition  6:  A  matrix  A  ,  is  called  nonnegative,  if  a.  .  >_  0  , 

1  £  i  ,  j  £  n  .  In  case  a.  .  >  0  ,  1  £  i  ,  j  £  n  ,  we  say  A  is  posi- 
five.  □ 


Definition  7:  A  matrix  A  is  called  upper  triangular  if 

i  >  j  =>  a .  .  =  0  , 
l  j 

and  lower  triangular  i f 

i  <  j  =>  a..  •  =  0  . 

It  is  called  a  diagonal  matrix  if  a- ^  =  0  for  i  f  j  .  □ 

"  *  vJ 

"k  k 

Definition  8:  A  matrix  U  is  called  uni tary  if  UU  =  U  U  =  I  .  □ 

Definition  9:  If  D  and  E  are  two  matrices  of  order  nxn  then  they 
are  called  similar  if  there  exists  a  nonsingular  matrix  S  such  that 
D  =  SES”"*  .  In  case  S  is  unitary  we  say  D  and  E  are  uni tari ly 
si  mil ar.  □ 

Definition  10:  Let  A  be  any  m*n  matrix  and  let  1  £  i^  <  i^  <  •••  < 
i|<  £  m  and  1  £  j,  <  <  •••  <  j  £  n  .  The  k x£  matrix  S  whose 

(a,B)th  element  is 


' 


J 


8 


= 


is  called  a  submatrix  of  A  .  In  case  k  =  £  and  i -j  =  j-j 
jk  ,  then  S  is  called  a  principal  submatrix  of  A  .  If  i-j  =  1  ,  i^  =  2 
•••  ,  ik  =  k  and  =  1  ,  =  2  ,  •••  ,  j^  =  £  ,  then  S  is  called  a 

leading  submatrix  of  A  .  If  a  submatrix  is  both  principal  and  leading 
then  it  is  called  a  leading  principal  submatrix.  □ 


Definition  11:  Let  S  be  a  submatrix  of  A  .of  order  r  £  n  .  Then  the 

determinant  of  S  is  called  a  minor  of  A  of  order  r  .  In  case  S  is 
a  principal  submatrix  of  A  ,  the  determinant  of  S  is  called  a  princi¬ 
pal  minor  of  A  of  order  r  .  Finally,  if  S  is  a  leading  principal  sub¬ 
matrix  then  determinant  of  S  is  called  a  leading  principal  minor  of  A  . 

□ 


Definition  12:  Let  x  and  y  be  any  two  real  vectors.  Let  the  indices 

i,  ,ios* •• ,i  be  such  that 
12  n 


and 


>  x. 

—  l 


5 


If 


>  y  >  •  •  • 

n2 


k  k 

I  x.  <  l  y.  ,  k  =  1 ,2,« •• ,n 
j=l  j=l 


then  we  say  y  weakly  majorizes  x  ,  and  write  x  <w  y  .  If  in  addition 

y  x.  =  y  y.  ,  we  say  y  majorizes  x  and  write  x  <y  .  □ 

i  1  i  1 


9P-f  r  /> 


r 


x  < 

. 
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CHAPTER  1 


TRACE  A 


§1 : 0  Prel  iminaries. 

The  trace  of  A  =  (ajj)nxn  >  denoted  by  tr  A  ,  is  defined  as: 

tr  A  =  l  a  . .  .  (1 ) 

i  11 

For  any  two  matrices  H  and  K  ,  (1)  implies  that 

tr  HK  =  tr  KH  .  (2) 

It  follows  from  (2)  that  similar  matrices  have  the  same  trace. 

Using  this  fact  together  with  Schur's  triangularization  theorem,  the 
following  result  follows: 

Theorem  1 :  For  any  matrix  A  and  positive  integer  k  , 

tr  Ak  =  l  .  (3) 

•  I 

Proof:  From  Schur's  triangularization  theorem  (see  e.g.  [31,  pg.  67]) 
there  exists  a  unitary  matrix  U  such  that  T  =  U*AU  is  an  upper  trian¬ 
gular  matrix  with  the  eigenvalues  of  A  along  the  diagonal.  Thus, 

k  ,  k  * 

Ak  =  (UTU  )K  =  UTkU 
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and  we  have. 


tr  Ak  =  tr(UTkU*)  =  tr  T 


k  =  l  A 


1 


which  completes  the  proof. 


□ 


Now  we  shall  derive  bounds  for  the  eigenvalues  and  the  singular 
values  of  A  which  involve  only  tr  A  and  n  . 


(a)  For  | A, |  =  max  | A . 

1  i  1 


Given  tr  A  , 


tr  A  |  /  n  <_  |  X  -j 


(4) 


Equality  holds  if  and  only  if. 


A,  =  A„  =  • • •  =  A 
i  2  n 


A I 


Proof:  From  Theorem  (1),  we  have  n|A^|  >_  £  |  A ^  |  >_  |  tr 
which  proves  (4).  The  conditions  for  equality  are  clear. 


The  following  result  is  immediate  from  (3): 


□ 


(e)  For  sum  of  eigenvalues: 


Given  tr  A  , 


X  ^.  =  tr  A  ; 


(5) 


■ 
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and 

I tr  A |  <  I  |A |  .  (6) 

i  1 

Equality  holds  in  (6)  if  and  only  if  A.  =  a.  A,  for  some 

vJ  J  * 

nonnegative  a.  ,  j  =  2,3,***,n  . 

\J 

□ 

(g)  For  singular  values: 


Given  tr  A  , 


|A 

n  —  1 


1^1 


(7) 


tr  A|  <  l  | A . |<Ia.  . 

i  1  i 


(8) 


For  normal  A  ,  equality  holds  in  (7)  if  and  only  if  A  is 
a  scalar  matrix,  and  equality  holds  in  (8)  if  and  only  if 


A.  =  a.  A,  for  some  nonnegative 

vJ  * 

a.  ,  j  —  2,3, 

*j 

k 

k 

Proof:  From  Theorem  11:4:1  (1), 

I  |A.| 

L  ,1 

<  l  o. 

i  1 

Thus  inequalities  (7)  and  (8)  are  immediate  from  (4)  and  (6). 
The  conditions  for  equality  are  clear  from  Theorem  11:0  (7) 
and  Theorem  11:4:1  (2) . 


' 


•jrc  -rj  n>  t  > i 0rf  \+,  t  upe  bn£  t>h}w  te  .  z  & 
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CHAPTER  2 


DIAGONAL  ELEMENTS 


§2:0  Prel iminaries. 

The  diagonal  elements  of  a  matrix  provide  quite  useful  infor¬ 
mation  about  its  eigenvalues.  For  example,  if  a  matrix  A  is  diagonally 
dominant,  that  is 


U.,1  >  I  |a..|  ,  i  =  1,2, •••,n  , 

then  det  A  is  non-zero  (see  6:2).  Also,  the  eigenvalues  of  an  Her- 
mitian  matrix  A  majorize  its  diagonal  elements  (see  12:2  (6)). 

We  shall  often  assume  that  the  diagonal  elements  ,  a^ 
i  =  1 ,2,- • • ,n  ,  of  A  are  ordered  as: 

ldi I  i  ld2l  >  •••  i  ldn!  »  0) 

where  d.  =  a.,  for  some  1  <  j  <  n  ,  i  =  l,2,*««,n  . 

1  \J 

Next,  we  state  the  necessary  and  sufficient  conditions  for 
the  existence  of  a  matrix  with  prescribed  diagonal  elements  and  eigen¬ 
values  or  singular  values.  The  proofs  can  be  found  in  [32,  pg.  230] 
and  [56]  ,  respectively. 

Theorem  1 :  A  necessary  and  sufficient  condition  for  the  existence  of  a 
real  (complex)  matrix  A  with  real  (complex)  eigenvalues  A^ jA^,***  ,An 


13 


bs-f '  rio  fl 
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and  diagonal  elements  a..  ,  i  =  l,2,***,n  is 


y  a . .  =  y  x . 

i  11  i  1 


(2) 

□ 


Theorem  2:  The  necessary  and  sufficient  conditions  for  the  existence  of 
an  nxn  matrix  with  diagonal  elements  a..  ,  i  =  l,2,**#,n  and  singu¬ 
lar  values,  0-,  >  o0  >  •••  >  a  are: 

1  —  2  —  -  n 


(  Mi  I  » I dg I  » I dn | )  (Q1  *CTn)  » 


(3) 


n-1 


1  1^ 


n-1 

| d  |  <  I  a. 
1  n1  —  |  i 


a 

n 


(4) 


where  the  |d.  |  1  s  are  given  by  (1). 


□ 


Next,  we  give  bounds  for  the  eigenvalues  and  singular  values 
of  A  ,  which  involve  only  the  diagonal  elements  of  A  and  n  . 


(a)  For  | A, |  =  max  | A. |  : 

1  i  1 


Given  a^  ,  i  =  1 ,2,**«,n  , 


—  | y  a. .  I  <  |\, 
n  1  4  n  1  —  1  1 


(5) 


Equality  holds  if  and  only  if. 


•  •  • 


■ 
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Proof:  Since 
1:0  (4). 


tr  A  =  l 
i 


the  result  is  immediate  from 


□ 


(e)  For  sum  of  eigenvalues: 

Given  a. •  ,  i  =  1 ,2,*** ,n  , 

I  I  a1-1- 1  1  I  1^1  •  (6) 

Equality  holds  if  and  only  if  A.  =  a.  A..  for  some  nonnega- 

vj  Sj  * 

tive  a.  ,  j  =  2,3,***,n  . 

vJ 

Proof:  By  definition  tr  A  =  J  a^.  .  Now  (6)  and  the  equality 
conditions  follow  from  1:0  (6). 

□ 

(g)  For  singular  values: 

Let  the  diagonal  be  ordered  as  in  (1).  Then: 
k  k 

I  |d. 1  1  l  a.  ,  k  =  1 ,2,**«,n  ; 

1  1  1  1 

n-1  n-1 

y  | d .  I  -  I d  I  <  y  a.  -a 

Equality  holds  in  (7)  and  (8)  if  and  only  if  A 

Proof:  Inequalities  (7)  and  (8)  are  clear  from  Theorem  (2). 
Further  if  equality  holds  in  (7)  we  have  a.  =  |d^|  , 


(7) 

(8) 

is  diagonal. 


-»d  . .  ••  j 


; 


1:2:0 
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i  =  1 ,n  .  Thus,  tr  AA  =  l 


a. 

i 


=  l 

i  ,j 


a .  . 
TJ 


=  I 


a . . 
1 1 


that  is  all  the  off-diagonal  elements  of  A  are  zero.  The 


converse  is  clear. 


□ 


CHAPTER  3 


TRACE  A2 


§3:0  Prel iminaries. 

By  definition  of  the  trace  of  a  matrix. 


tr  A 


-  i 
•  • 


1J  JT 


(1) 


Below,  we  derive  bounds  for  the  eigenvalues  and  the  singular 

2 

values,  which  involve  only  tr  A  and  n  . 


(a)  For  | X-j  |  =  max  | X ^  |  : 

Given  tr  A2  , 

(\trjh.yn  ±lh{  _  (2) 

Equality  holds  if  and  only  if,  A-j  =  A^  =  •••  =  An  . 

Proof:  Inequality  (2)  is  immediate  from  the  triangular  inequal¬ 
ity  and  1:0  (3).  Also,  the  conditions  for  equality  are  clear. 

□ 


(e)  For  sum  of  eigenvalues: 

The  following  result  follows  from  1:0  (3): 
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Given  tr  A2  , 


l  X.2  =  tr  A2  ; 

(3) 

i 

| tr  A2 I  <  T  | X . 2 |  . 
i  1 

(4) 

Equality  holds  in  (4)  if  and  only  if  X.  =  a.  X,  ,  for  some 

\J  J  * 

nonegative  a.  ,  j  =  l,2,**«,n  . 

3 

□ 


(g)  For  singular  values: 

Given  tr  A2  , 

<*> 

and 

I tr  A2|  £  £  a.2  .  (6) 

For  normal  A  ,  equality  holds  in  (5)  if  and  only  if  A  is  a 

scalar  matrix  and  in  (6)  if  and  only  if  X.  =  a.  X,  for  some 

J  >3 

nonnegative  cu  ,  j  =  1 ,29* • • 5n  . 

»j 

Proof:  Inequalities  (5)  and  (6)  follow  from  (2)  and  (4)  and 

Theorem  11:4:1  (1).  The  equality  conditions  are  clear  from 

Theorems  11:4:1  (2)  and  11:0  (7). 

□ 


A  1J| 


^  *  c-  yt ir  hn  Vi  3)  r;.  bnf.  xhttwn  n6f/o 


. 
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§3:1 


Given  tr  A  and  tr  A  the  results  of  Section  0  and  1:0 
can  be  combined  to  yield  the  following: 


(a)  For  | A, |  =  max  | A . |  : 

I  -  1 


Given  tr  A  and  tr  A  , 


max 


1 tr  A |  | tr  A 


2,1/2 


n 


(1) 


Equality  holds  if  and  only  if  all  the  eigenvalues  are  equal. 


□ 


(g)  For  singular  values: 


Given  tr  A  and  tr  A  , 


,  | tr  A |  | tr  A 

max  |  J — - — L  ,  J - 


2,1/2. 


n 


n 


±G1 


(2) 

□ 


1:3:2 


20 


§3:2 


In  addition  to  results  of  Section  1,  the  following  result 


holds 


(g)  For  singular  values: 


Given  tr  A  and  the  diagonal  elements  of  A  , 


max  ( 


tr  A 


2  1/2 


,  max  I  a . .  | )  <  an 
i  n  —  i 


(1) 


Proof:  Inequality  (1)  is  immediate  from  0  (5)  and  2:0  (7). 


□ 


■ 


CHAPTER  4 


TRACE  AA* 


§4:0  Preliminaries. 


Given  an  nxn  matrix  A  ,  by  definition  tr  AA  =  l  |a. . 

i,j 

Also,  the  Euclidean  norm  (Frobenius  norm)  of  A  is  defined  as: 


||A||2  =  tr  AA*  .  (1) 

■k  *  ★ 

Further,  AA  is  positive  semi  definite,  as  (AA  )  =  AA  and 

★  ★  *  * 

(AA  x,x)  =  (A  x,A  x)  _>  0  .  Thus,  the  eigenvalues  of  AA  are  real,  non- 

* 

negative.  The  positive  square  roots  of  the  eigenvalues  of  AA  are 
called  the  singular  values  of  A  .  The  relationships  among  the  eigen¬ 
values  and  the  singular  values  of  a  matrix  are  discussed  in  11:4:1. 

As  always,  we  shall  assume  that  the  singular  values  of  A  are 
ordered  as: 


a,  >  o0  >  •••  >  a 

1  —  l  —  —  n 


(2) 


It  follows  from  the  above  discussion  that. 


=  tr  AA* 


(3) 


★ 

Next,  we  give  bounds  which  involve  only  tr  AA  and  n  . 
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(a)  For  | X, |  =  max  | X . |  : 

1  i  1 

Given  tr  AA  , 

|  X^  |  ^  <_  tr  AA  . 

Proof:  Inequality  (4)  is  clear  from  (9)  below. 

(b)  For  | X  |  =  min  | X . |  : 

n  i  1 

Given  tr  AA  , 


(4) 

□ 


|  Xn  |  2  <_  tr  AA  /  n  (5) 

For  normal  A  equality  holds  if  and  only  if 

|X.j  |  =  |X^|  =  •••  =  | X  |  ,  which  is  so  if  and  only  if  A  =  ell  , 

for  some  unitary  U  and  scalar  c  . 

Proof:  Inequality  (5)  follows  immediately  from  (9)  below  and 
the  equality  conditions  are  clear  from  Theorem  11:0  (6). 

□ 


The  following  result  follows  from  (9),  below: 

(c)  For  |Xk|  : 

Given  tr  AA  , 

I \  I- 2  £  tr  AA  /  k  ,  k  =  1 ,2 , •  •  •  ,n  . 


(6) 

□ 


-  * 


' 

•  -•*: 
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(d)  For  the  spread: 

Given  tr  AA  , 


*  1/2 

sp ( A)  <  (2  tr  AA  ) 


(7) 


Proof:  We  have  sp(A)  £  |X^|  +  \\^\  £  cr-|  +  .  Also,  from 

the  Cauchy-Schwarz  inequality  (ai+a2'  £  2(a^+a2  )  £  2  tr  AA  , 

which  completes  the  proof.  Inequality  (7)  also  follows  from 
1(6)  below. 

□ 


(e)  For  sum  of  eigenvalues: 

Given  tr  AA  , 

l  |^i |  £  (n  tr  AA*)1/2  ,  (8) 

l  |X  |2  £  tr  AA*  .  (9) 

i  1 

Equality  holds  in  (8)  if  and  only  if  A  is  a  scalar  matrix. 
Equality  holds  in  (9)  if  and  only  if  A  is  normal. 

Proof:  Inequality  (9)  is  immediate  from  (3)  and  Theorem 
11:4:1  (1).  Also  from  Theorem  11:4:1  (2)  a.  =  |X. |  , 
i  =  l,2,*«*,n  ,  if  and  only  if  A  is  normal.  Further,  from 
the  Cauchy-Schwarz  inequality  we  have,  |  £  X.|  £n  £|X.| 

and  equality  holds  if  and  only  if  =  •••  =  Xn  .  Now 

(8)  follows  from  (9),  while  the  equality  condition  follows 


1:4:0 
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from  Theorem  11:0  (7). 

□ 


(f)  For  product  of  eigenvalues: 


Given  tr  AA  , 


-\  i  ^  /(tr  AA  )^V/2  i  _  to 

'rV"’,Ak:  -y  ki  J  ■  k  1  ’2>,">n  • 


do) 


Proof:  The  proof  is  irrmediate  from  (6). 


— 


(g)  For  singular  values: 

The  results  given  below  are  immediate  consequences  of  (3). 
* 

Given  tr  AA  , 


*  o  * 

tr  AA  /  n  £  c-|  £  tr  AA  ; 

£  tr  AA  /  k  ;  k  =  1 ,2,***  ,n 

a =  tr  AA 


(ID 

(12) 


(13) 


' 
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§4:1 

ic 

In  this  section  we  shall  give  results  which  involve  tr  AA  , 
tr  A  and  n  .  Most  of  the  results  are  proved  in  [631.  Their  proofs 
involve  the  inequalities, 

l  |X.|2  <  tr  AA  ,  | tr  A|  <_  £  | A.  |  £  (n  tr  AA  )^2  , 

i  1  i  1 

and  the  Cauchy-Schwarz  inequality.  We  shall  omit  these  proofs.  Follow¬ 
ing  [631  we  define: 

m  =  tr  A  /  n  and  s  2  =  tr  AA  /  n  -  |m| ^ .  (1) 

r\ 

(a)  For  | X-j  |  =  max  |X.  |  : 

Given  tr  AA  and  tr  A  , 

M  £  l^]l  1  lml  +  •  (2) 

Equality  holds  on  the  right  if  and  only  if  A  is  normal, 

X  =  X  =  •••  =  X  and  X.  =  cm  for  some  c  >  1  . 

2  3  n  1  - 


Proof:  See  [63] . 


□ 


(b)  For  | X  |  =  min  | X.  |  : 

n  .  i 

Given  tr  AA  and  tr  A  , 


A 


(n-1)1/2  <  | A  |  <  (tr  Afl  )1/2 
'  —  1  n 1  —  n 


n 


(3) 
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Equality  holds  on  the  left  if  and  only  if  A  is  normal, 

^1  =  ^2  =  ***  =  1  anc*  ^1  =  cm  "*r°r  SOme  rea"*  nonne9atl*ve 

scalar  c  £  1  .  Equality  holds  on  the  right  if  and  only  if 

A  is  normal  and  |X^|  =  | |  =  •••  =  | X^ |  . 

Proof:  See  [63] . 

□ 


(c)  For  | X.  |  : 


Given  1  <  k  <  n  , 


m|  -SA(^)1/2i|Akll(£^)'-  +  SA(^)'' 


tr  AA  xl/2  ,  _  / n-k n 1/2 


(4) 


Equality  holds  on  the  left  if  and  only  if  A  is  normal  and 


A1  X2  ***  \-l  and  Ak  \+l  *’*  Xn  "  cX]  *  ^ 

for  some  nonnegative  c  .  Equality  holds  on  the  right  if  and 
only  if  A  is  a  scalar  matrix. 


Proof:  See  [63] . 


(d)  For  the  spread: 


□ 


For  any  A  , 

sp(A)  <  (2  tr  AA*  -  £  |tr  A|2)1/2  . 


(6) 


r-/  •  •”  ’V  *  ix 


■ 
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Equality  holds  if  and  only  if  A  is  normal  and  (n-2)  eigen¬ 
values  are  equal  to  each  other  and  the  arithmetic  mean  of  the 
remaining  two. 


Proof:  See  [40]. 


(e)  For  sum  of  eigenvalues: 


Defining, 


□ 


i 


|A|(M)  '  i-k+1  ik  |Aj!  ’ 


m  and  s^  as  in  (1), 


(7) 


m 


Equality  holds  on  the  left  if  and  only  if  A  is  normal. 


X1  X2  '  ***  Xk-1  and  Xk  =  Xk+1 


•  •  • 


=  An  =  cX]  ,  (9) 


with  c  real  and  nonnegative.  Equality  holds  on  the  right  if 
and  only  if  A  is  a  scalar  matrix. 


Proof:  See  [63] . 


□ 


. 
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§4:2 

Given  the  diagonal  elements,  we  know  the  tr  A  .  Hence,  all 
the  results  of  Section  1  hold.  In  addition,  we  have  the  following: 

(g)  For  product  of  eigenvalues: 


If  a.  .  =  1  ,  i  =  1 ,2,*««  ,n  and  t  =  (tr  AA  - 

n)  <  1  then: 

exp(t^)  (1-t^)  £  | det  A| 

(1) 

Proof:  See  [7,  pg.  72] . 

□ 

1:4:3 
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§4:3 


•k  2 

When  tr  AA  and  tr  A  are  known,  clearly  the  results  of 
Section  0  and  3:0  hold.  In  addition,  the  following  bounds  for  the  sum 
of  the  squares  of  real  and  imaginary  parts  of  the  eigenvalues  of  A  are 
given  in  [39,  pg.  309]: 


(e)  For  sum  of  eigenvalues: 


With  B  =  ^-(A  +  A*)  and  C  =  -  iC )  , 

l  (Re(A  .))2  £  tr  B2  =  -ktr  AA  +  Re(tr  A2) )  ;  (1) 

i  1  d 

|  (Im^))2  £  tr  C2  =  l(tr  AA  -  Re(tr  A2) )  ,  (2) 

with  equality  in  (1)  if  and  only  if  equality  holds  in  (2)  if 
and  only  if  A  is  normal . 


Proof:  By  Schur's  triangularization  theorem,  there  exists  a, 

unitary  matrix  U  and  an  upper  triangular  matrix  T  ,  with 

* 

eigenvalues  of  A  along  the  diagonal  such  that  A  =  U T U  . 

Thus,  A  +  A*  =  U(T+J*)U*  and  tr(A  +  A*)2  =  tr(U(T+T*)2U*)  = 
tr(T  +  T*)2  =  tr  T2  +  tr  T*2  +  2  tr  TT*  .  Thus, 

tr  B2  >  l  (tr  T2  +  tr  T*2)  =  1  \  (Re(X.))2  .  (3) 

Now,  (1)  follows  by  observing  that  tr  B2  =  (tr  AA  +  Re(tr  A2)) 
and  that  equality  holds  in  (3)  if  and  only  if  A  is  normal. 


. 


Inequality  (2)  follows  by  repeating  the  above  reasoning  for 
(A  -  A  )  ,  instead  of  ^  (A  +  A  ) 


' 
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§4:3.1 


In  this  section  we  shall  give  bounds  which  involve  tr  AA  , 

2 

tr  A  and  tr  A  .  All  the  results  given  below,  are  proved  in  [63]. 

We  will  need  the  following  notation: 

Let  the  moduli  ,  real  and  imaginary  parts  of  the  eigenvalues  of 
A,  arranged  in  decreasing  order  be  denoted  by  A.^,  A.^  and  a.  ^  , 

I  J  K 

respectively.  That  is. 


where. 


A  (A> 
X1 

IV 

>-* 

ro 

IV 

• 

• 

• 

IV 

v»  • 

(1) 

A 

A1 

*  >2IW  ■ 

• • •  >  A  ^  ;  and 
n 

(2) 

A  (0 

A1 

IV 

ro 

o 

IV 

(3) 

A  <A>  =  lx. I  ,  A.<B>  =  Re( A . )  ,  and  A.^  =  Im(A.)  .  (4) 

i  1  i 1  i  v  i  '  i  v  v  '  ' 


Also  we  recall  that, 

* 


tr  BB  =  -?r(tr  AA  +  Re(tr  AB))  and  tr  CB  =  ^-(tr  AA  -  Re(tr  AB)) 


(c)  For  A, 


(i)  Let  A  be  an  nxn  complex  matrix.  Define 


mg  =  Re(tr  A)  /  n  =  tr  B  /  n  ,  =  Im(tr  A)  /  n  =  tr  C  /  n  , 
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2  2  2  2  2  2 
sR  =  trB  /n-mn  ,  s  =trC  /n-m  . 
B  B  c  C 

Then,  for  T  =  B  or  C  , 

^  <_  m-j-  +  Sj  (n-1  )^2  . 

Equality  holds  if  and  only  if  A  is  normal  and 


=  X 


(T) 


n 


Proof:  See  [63] . 

(ii)  With  m^  ,  s^  as  above,  for  T  =  B  or  c  » 

mT  -  sT(n-l)1/2  <  A  <T)  . 

T  T  -  n 

Equality  holds  if  and  only  if  A  is  normal  and 


x  (T)  =  x  (T)  _ 
A1  A2 


=  X 


n-1 


(T) 


(5) 


(6) 


(7) 


□ 


(8) 


(9) 


Proof:  See  [63] . 


□ 


(iii)  With  m^  ,  as  in  (5),  for  T  =  B  or  c  and  1  <_  k  £  n  , 


m  -  s  ■,  (t)  +  s  (n1k)l/2 

T  sj  n-k+1 '  -  k  -  j  T  k  ' 


(10) 


Equality  holds  on  the  left  if  and  only  if  A  is  normal  and 


(or) 
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X1(T>  =  X2(T> . Xk-/T)  and  Xk(r>  =  Xk+1(T)  =  =  Xn(T>' (11) 


Equality  holds  on  the  right  if  and  only  if  A  is  normal  and 


VT)  =  X2(T)  =  -  =  Xk(T>  and  Xk+1(T>  '  V2(T)  =  •"  =  Xn(T)-  (12) 


Proof:  See  [63] . 


□ 


(e)  For  sum  of  eigenvalues: 

(i)  With  m-j.  ,  s^  for  T  =  B,C  ,  given  by  (5)  and 


(B) 

1 

£ 

I 

j=k 

x  (B)  . 

Xj 

03) 

(M) 

£-k+l 

(0 

1 

£ 

I 

j=k 

X  (c) 

Xj 

(14) 

(k,£) 

£-k+l 

we  have: 


.  -  s  <  X  (T) 

"V  ST  n-k+1 '  -  (k,£) 


n-£>,  1  /2 

£  ' 


When  (k,£)  =  (l,n)  the  inequality  string  collapses.  When 
(k,£)  f  (l,n)  ,  equality  holds  on  the  left  if  and  only  if  A 
is  normal  and  (11)  holds.  Further,  equality  holds  on  the 
right  if  and  only  if  A  is  normal  and, 

=  ^<T)  =  *"  =  X£T)  and  X£+/T)  =  X£+2<T)  =  =  Xn(l)  '  (15) 

Proof:  See  [63] . 

□ 


i'il 
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(ii)  If  1  <  k  <  Z  <  n  ,  then  for  T  =  A,B  or  C  , 


A  W  A  (T)  <  c  n1/2  f1  +  1  ^/2 

Ak  '  -  ST  n  (k  +  rHl+f 


(16) 


Equality  holds  if  and  only  if  A  is  normal  and 


X  (l)  =  x  (T)  =  ...  =  A  (T)  ■ 

1  2  k 


k+1 


A,  JT)  .  A,  .„(T)  .  ...  .  x.  .(T)  . 


Lk+Z 


£-1 


m 


T  9 


(17) 


(T)  =  (T)  =  ...  =  x  (T) 


V  XZ+ 1 


n 

l  IM 

1  J 

where  m,  =  -  and  for  T  =  A.  , 

A  n 


X.  =  a.  >  1  ,  j  =  2 ,  •  •  • ,  n  , 

o  J 


(18) 


for  some  nonnegative  scalars  a.  ,  j  =  l,2,..*,n 

u 


Proof:  See  [63]. 


□ 


CHAPTER  5 


TRACE  (AA*-A*A)2 


5:0  Preliminaries. 

We  recall  that  the  Euclidean  (Frobenius)  norm  of  a  matrix  A  , 

i  i  i  1 2  * 

is  given  by  | |A| |  =  tr  AA  .  Let 

D  =  AA*  -  A*A  .  ( 1 ) 

Clearly  D  is  Hermitian  and  therefore, 

..1,2  2  ,  *  *  v  2 

|  |  D  |  r  =  tr  D  =  tr(AA  -  A  Ar  . 

By  definition,  A  is  normal  if  and  only  if  D  =  0  .  Further,  since 
AA  and  A  A  have  the  same  diagonal  elements,  tr  D  =  0  .  Thus,  for 
a  nonnormal  matrix  A  ,  D  has  both  positive  as  well  as  negative  eigen¬ 
values.  Finally,  it  is  well-known  that  D  is  positive  semi  definite  if 
and  only  if  A  is  normal  (e.g.  see  [16]).  For  if  D  is  positive  semi- 
definite,  then  tr  D  =  0  implies  that  all  the  eigenvalues  of  D  are 

zero.  Therefore,  from  0  =  tr  D  =  l  |d..|  ,  we  have  d..  =  0  , 

ij  1J 

i  ,j  =  l,2,***,n  .  Thus  A  is  normal.  The  converse  is  trivial. 

Now,  we  give  some  bounds  involving  | ] AA  -A  A| |  ,  and  n  . 

(g)  For  singular  values: 

Given  A  , 


35 


A  A  - 


• 

' 
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*  * 


*  * 


!/2  n  2 
n  cr-j  , 

(2) 

1/2  I  a.2  . 

V  1 

(3) 

Proof:  Inequality  (2)  is  immediate  from  (3).  To  prove  (3), 
we  observe  that, 


|  I AA  -A  A|  I2  =  tr(AA  -  A  A)2  =  2  tr(AA  )2  -  2  tr(A2A  2) 


=  2  | | AA* | | 2  -  2 | | A2 1 1 2 


<  2  | | AA* | |2  <  2 


which  completes  the  proof  of  (3). 


□ 
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§5:4 

In  this  section  we  shall  give  bounds  for  the  sum  of 
values,  which  involve,  | |A| |  and  ||AA  -  A  A | |  . 

(e)  For  sum  of  eigenvalues: 

(i)  With  D  as  in  (1), 

l  |Ai|2£(||A]|4-l||D||2)1/2  . 

Equality  holds  if  and  only  if 

•k  k 

A  =  a ( vw  +  r  wv  )  , 

where  a  e  (p  with  a  /  0  ,  0  <  r  <  1,  and  u,w  are 
mal  vectors. 

Proof:  See  [25] . 

(ii )  Given  | | A| |  and  | | D| |  , 

l|A||2  -  (^f)172  IlDll  1  l  IV2  • 
Proof:  See  [20] . 


the  ei gen¬ 


ii) 


(2) 

orthonor- 


□ 


(3) 


□ 
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§5:4.1 


In  this  section  we  shall  give  bounds  which  involve  ||A||  , 

*  -k 

| | AA  -A  A | |  and  tr  A  .  All  of  the  results  to  follow  are  proved  in 
[641.  We  shall  need  the  following  notation: 


Suppose  A-j  jA.^,***  ,An  are  complex  eigenvalues  of  A  .  Define, 


AjA  =  | X i  |  ,  AkB  =  Re^)  ,  A£C  =  Im(A.)  , 


(1) 


so  that  the  ordered  vectors  (A.  )  satisfy 


x/  >  A2T  >  •••  >  XnT  ,  T  =  A,B,C  , 


and 


l  |X,A|2  -  I  |A  I2  ,  l  [ A .B | 2  =  l  (Re(A  ))2  ,  l  |A  C|2  =  l  (Im(A  ))2. 
l  1  i  1  i  1  i  1  i  1  i  1 


Further  ,  let 


K 


A 


4  1 

"  2 


2)1/2 


K 


£ 


A 


2  ,n°-nJ/2 

"12 


(2) 


(l|B||4  -  l  ||D||2)1/2 


Kn  = 


2  J_ 
'  12 


I  I A  |  | 


if  ||B||  >  ||C||  , 


otherwi se. 


k/  =  I  i  B  |  | 2  -  (^)1/2 


(3) 


. 
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(I|C||4-1||D||2)1/2  if 


llcll2 


JL 

12 


otherwise. 


llcll2  -  <Tf)1/2 


(4) 


Finally  define. 


l  |a-t|2  |I  x  t|2 
2  i  1  i  1 


,  T  =  A,B,C  , 


m 


u  /'KA^1/2 


A  V  n 


,  m 


£  I tr  A I 


A  n 


u  £  tr  B 
mB  mB  =— 


u  £  _  tr  C 
*  mC  mC  n 


u  ,2 

U  ?  “  1 f 1  /  ^ 

(ST  r  =  J - - -  ,  T  =  A,B,C 


„  2  K  £  -  | tr  T|2  /  n 

( Sy  r  =  max  {0  ,  - - - 


•}  ,  T  =  A,B,C 


(5) 


(6) 


(7) 


(a)  For  | X, |  =  max  | A. |  : 

1  i  1 

With  the  above  notation: 

mA£  +  (n-1  )_1//2  sA£  £  | A1  |  £  mAU  +  (n-1  )^2  sAu  .  (8) 

Proof:  See  [641 . 

□ 


. 
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(b)  For  | Xn |  =  min  \X.\  : 


With  the  above  notation 


m 


i 


A 


-  (n-l)1/2  sAu  <  |Aj  <  mAu  -  (n-1 ) 


-1/2  c  £ 
SA 


(9) 


Proof:  See  [64] . 


(c)  For  |X.|  : 


Given  1  <  k  <  n  , 


□ 


m 


A 


r  k-l  J/2  „  u  ,,  |  .  m  u  i-  rn"kl1/2  ~  u 
(n-k+V  SA  -  'V  -  mk  +  1  k  1  SA 


(10) 


Proof:  See  [64]. 


(d)  For  the  spread: 


□ 


With  s A^  ,  sAu  as  in  (7), 


2  s/  <  sp ( A)  <  (2n)1/2  sAJ 


(ID 


Further,  if  n  is  odd,  then: 


(n2^1/2  SA£  -  Sp(A) 


Proof:  See  [64]. 


□ 


. 
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(e)  For  sum  of  eigenvalues: 


For  1  <  j  <  k  <  n  , 


m 


4  IX, 


A  vn-j+l 


A  -  k-j+1  i=j 


.  u  ,  ,n-kxl/2  u 
i  mA  +  (— )  sA  ; 


(12) 


l  ,  f  ,  x  -1  ,  -  x-l/2  £  1  r  |  . 

mA  +  (n-k)  y  (n-1 )  sa  -  F  J  lXi 


where  y  =  max(k,n-k)  ;  with  y  =  max(n-k+l ,k-l )  , 


1 


n 


n-k+1  ^  ^i 


—  mA 


-1 


-  (k-l)y  (n-1)  '  s 


-1/2  „  l  . 


A  ’ 


and 


|X.|  -  | A,  |  <  (i  +  — 1-=-) 
1  j  1  1  k 1  -  n-k+1 ' 


1  J/2  1/2  -  u 

n 


(13) 


Proof:  See  [64]. 


□ 


(f)  For  product  of  eigenvalues: 

Given  A  , 
k  k 

n  |Ai  I  <  n  (mAu  +  ((^)1/2)  sAu  ,  k  =  1 ,2, •  •  •  ,n  . 

Proof:  The  proof  is  immediate  from  (10). 

□ 


' 


1:5:4. 1 


42 


(g)  For  singular  values: 

Given  A  and  m^  ,  ,  s ^  ,  s^u  as  in  (6)  and  (7), 

m/\£  +  (n"l  )"1/2  sa^  -  al  ;  04) 

an  £  mau  -  (n-1 )"1/2  s^Z  .  (15) 

Proof:  Since  |A^|  £  and  |An|  £  ,  the  above  inequali¬ 

ties  follow  from  (8)  and  (10). 

□ 


(h)  For  the  condition  number: 


If  -  (n-1)^2  sAu  >  0  ,  then. 


mA£  +  sA£  /  (n_1  )1//2  lAi  I 
mA£  -(n-l)1//2  sAu  “  lAnl 

Proof:  As  I  A, I  <  a,  and  I A  I  >  a  , 
-  1  1  1  —  1  1  n 1  —  n 

from  (8)  and  (9). 


c(A)  .  (16) 

the  proof  is  immediate 


□ 


torrf  r  r.  |fA!  gA 

,{«)  bn.  (8)  «rrt  4 
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§5:4.3 


The  bounds  for  the  sum  of  the  squares  of  real  and  imaginary 
parts  of  the  eigenvalues  of  A  ,  given  in  4:3  can  be  improved  when 

ic  ic  o 

|  |  AA  -  A  A  |  |  ,  |  |  A  |  |  and  tr  I\  are  known : 

(e)  For  sum  of  eigenvalues: 

With  (A/)  ,  Kj ^  and  KjU  as  given  by  4.1  (1),  4.1  (2),  4.1 
(3)  and  4.1  (4), 

Kj£  <  l  |X1T|2  <  KtU  ,  T  =  B,C  . 

Proof:  See  [64] . 

□ 


■ 
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§5:4. 3.1 

In  this  section  we  shall  state  bounds  for  the  real  and  imaginary 
parts  of  the  eigenvalues  of  A  ,  which  involve  ||A||  ,  | |AA  -A  A||  , 
tr  A2  and  tr  A  . 

All  the  bounds  given  below,  are  proved  in  [64].  We  shall  omit 
their  proofs.  We  recall  that 


B  =  1  (A  +  A*) 

,  C 

1 

"  2i 

tr  B2 

=  1  (tr  AA  +  Re(tr  A2) ) 

and 

tr 

Also 

,  mT' 

i  _  u 

,  m-j. 

„  l  -  u  - 
’  ST  ’  ST  * 

T  =  B 

,c 

(6) 

and  4 

.1  (7). 

Lastly,  we  assume 

that 

a.t 

1 

4.1 

(1). 

(a) 

For 

A1  : 

Given 

A  ,  then  for  T  = 

B,C  : 

£ 

mT 

+  (n-ir1/2  s/  < 

U 

mT 

Proof: 

See  [64]. 

(b) 

For 

An  : 

Given 

A  ,  for  T  =  B,C  : 

m  £ 
mT 

-  (n-l)1/2  sTu  <  A 

nTi' 

u 

'T  ' 

.2  _  1 

2 


1/2  u 


(1) 


-1/2  £ 
ST 


(2) 
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Proof:  See  164] . 


(c)  For  Ak  : 


For  T  =  B,C  , 


□ 


i  ,  k-1  J/2  u  „  ,  T  „  u  ,  , n-kN  1/2  u 
mT  -  ^rTk+f  ST  i  Ak  i  mT  +  <— >  ST 


(3) 


Proof:  See  [64] . 


(d)  For  the  spread: 


Given  A  ,  then: 


2  sb£  <  spR(A)  <  (2n)1/2  sBu  ; 


2  <_  spj(A)  £  (2n£2  SqU 


Further,  if  n  is  odd: 


2  sn£  n  /  (n2-l)1/2  <  spR(A)  , 


2  n/  (n2-l)^2  £  spj(A)  . 


□ 


(4) 


Proof:  See  [64]. 


□ 


r 
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(e)  For  sum  of  eigenvalues: 


Given 


1  <  i  <  j  <  k  <  n  ,  then  for  T  =  B,C  , 


l  /  j-1  J/2  „  u  ^  1  v  a  T  „  „  u  ,n-kvl/2  u 


m  -  ( — X - \  '  c  < 

mT  n-j+1  ST  -  k-j+1  ^ 


X  imT  +  hr 1 


’T 


Z  ,  /  -1/  -I  N -1/2  Z  1  r  T 

mT  +  (n-k)  y  (n-1 )  sj  -  k  .2,  Ai 


where  y  =  max(k,n-k)  ; 


1  ■  ?  ,  T  „  u  ,,  -1,  ^-1/2  Z 

HZFT  X  Ai  —  mT  -  (k-1)  Y  (n-]>  ST  > 

1  K 


where  y  =  max(n-k+l ,k-l )  ;  and 


•  1 


-  (j  +  n-k+l 


1  .)l/2nl/2 


Proof:  See  [64] . 


□ 


(d)  For  singular  values: 

For  T  =  B,C  , 

Z  ,  /  i  \  — 1/2  Z 
m-j-  +  (n-1 )  Sj  <_  a-| 

Proof:  The  inequality  is  immediate  from  4.3.1  (1),  as 
Re(A.j )  £  |  A-|  |  £  a-|  • 

□ 


n'n 


CHAPTER  6 


ROW  AND  COLUMN  SUMS 


§6:0  Prel iminaries. 

Given  a  matrix  A  ,  its  row  and  column  sums  can  be  calculated 
quite  easily.  Thus,  the  bounds  for  eigenvalues  involving  row  or  column 
sums  can  be  quite  useful.  Perhaps,  this  is  the  reason  that  many  inequal¬ 
ities  relating  eigenvalues  and  row  (column)  sums  are  known.  The  row 
(column)  sums  together  with  the  diagonal  elements  yield  very  useful 
results.  The  Gerschgorin  Theorem  (see  Section  2)  is  one  example. 

We  shall  use  the  following  standard  notation  for  the  various 

sums : 


r.  =  y 

1  j 

1  a .  •  1  ,  C  . 

1  U  1  J 

11 

1  a .  .  1  ,  1  <  i  , 

1  iJ  1  - 

j  1  n  , 

P.  =  R.  - 
1  1 

1  a . .  1  ,  Q .  = 

1  n1  3 

C. 

3 

-  |ajj[  ;  1^i 

,  j  <n  , 

R  =  max  R. 
i  1 

and 

C  =  max  C . 

3  3 

Also, 

r. 

1  a .  .  1  x  . 
-  v  1 J  J 

1  a .  .  1  x . 
c  -  Y  1J  1 

L  Y 

j  Xi 

5 

J  i  xj 

where. 

x.  >  0  and  i 

i 

,j  =  1 ,2,«*« , 

n  . 

Further,  we  shall 

assume  that 

W* 

•*,i  is  a  permutation  of  the  integers  l,2,***,n 

such  that. 

r .  >  r  . 

11  1 2 

>  • 

-iri  • 

n 

(1) 


(3) 


(4) 


(5) 
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. 
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As  always  we  shall  assume  that  the  complex  eigenvalues  of  A 
are  ordered  as. 


I  1  l*2l  -  *’*  -  *  (6) 

Before  we  give  bounds  for  eigenvalues,  observe  that  the  eigen¬ 
values  of  A  and  A'  are  the  same.  Thus,  bounds  involving  row  sums  are 
also  true  for  column  sums. 

Now,  we  give  the  bounds  which  involve  only  row  and  column  sums. 

(a)  For  | A, |  =  max  | A . |  : 

1  i  1 

With  R  as  in  (3), 


|A-j|  1  R  •  (7) 

If  A  is  irreducible,  |A^|  =  R  if  and  only  if 

R,  =  R  =  •••  =  R  and  A  =  e1'0  D-"'  PD  ,  where  D  is  a  diag- 
I  Z  n  3 

onal  matrix  with  |d. .  |  =  1  ,  P  =  (|a..  .|)  and  0  is  a  real 
number.  In  fact  if  r.  is  as  in  (4),  then: 

|  A^  |  <_  max  | r .  |  .  (8) 

Proof:  Inequality  (7)  follows  from  Gerschgorin 1 s  Theorem 
below.  The  conditions  for  equality  are  given  in  [50].  Inequal¬ 
ity  (8)  follows  when  (7)  is  applied  to  X_1AX  s 
x  =  diag(x1,x2,...,xn)  . 


1:6:0 
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(b)  For  |X^  |  =  min  | |  : 

If  R.  or  C.  is  zero  for  some  1  £  i  £  n  ,  then 

|X  |  =  0  . 

n 


(9) 


Proof:  The  proof  follows  from  (15)  below,  or  more  simply  that 
A  must  be  singular. 

□ 


(d)  For  the  spread: 


With  r.  as  in  (5), 


sp ( A)  <  |X,|  +  |XJ  <  r  +  r  .  (10) 

-  i  ^  n-|  n2 


Proof:  Since  sp(A)  £  |X-||  +  | X^ |  >  (9)  follows  from  (11) 
below,  when  a  =  1  and  i  =  2  . 

□ 


(e)  For  sum  of  eigenvalues: 

as  in  (5), 

,  a  _>  0  ,  1  £  Z  £  n 

Proof:  See  [50] . 


(i)  With  r.  ,  k  =  1 ,2,***  ,n 


a 

i  iv 

k=l  K 


a 


^  a 

1  I  r- 

k=l  1  k 


OD 


□ 
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(ii )  Given  A  , 


I  ly  I2  i  l  R-2  -  (p-q)2 

i  1  i 


where. 


(12) 


n  1  /  v  u  .  | 2x1/2  0  1  ,  v  ,  | 2x1/2 

p  =  —  (  )  c.-c.  )  ,  q  =  —  (  )  y.-y.  )  , 

n  i<k  1  ^  n  i<k  1  ^ 


c .  =  T  a  . .  and  r .  =  7  a . . 
i  ?  ji  i  L,  1J 


1  5  1J 


Proof:  From  (21)  below,  \  a.  = 

i  1 

result  follows  from  4  (1),  below. 


^  .  Now,  the 


□ 


(f)  For  product  of  eigenvalues: 


(i)  Given  1  <  £  <  n  and  r •  as  in  (5), 

“  “  1  k 

£  l 

n  | x.  I  <  n  r.  .  (13) 

1  K  1  \ 

In  particular, 

£  £ 

n  |x.  |  <  n  r.  ,  (14) 

i  K  l  \ 

and  for  £  =  n  , 


n 

| det  A|  <  n  R.  .  (15) 

1  1 


When  A  is  irreducible, 
k  k 

n  I  A. I  =  n  R.  for  k  =  1 ,2,« • • ,&<n  , 

i  1  i  1 


br« 


:<n  f.  v  :  gn  •  r  :  *  *  p ) 


. 


-i 
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if  and  only  if 

hi  =  lA2l . h1  =  R1  =  R2  =  •"  =  Rn  • 

Proof:  See  [50]. 

□ 

(ii)  If  R.  or  C.  =  0  for  some  1  <  i  <  n  ,  then: 

'  '  i  i  —  — 

| det  A |  =  0  . 

Proof:  Proof  is  immediate  from  (15). 

□ 

(g)  For  singular  values: 

(i)  Given  A  , 

R  /  n^2  <  max  (£  |a.  ■  |2)^2  <  a-,  <  i  (t,  +  tj  ; 

i  5  J  1  2  1  2 

a  <  min  (Y  la.  •  |2)^2  <  min  R.  , 

n  “  i  j  13  “  i  1 

k  ^  i  2k 

I  a  a  io  I  t.-a  »  a_>0,k  =  l,2,**»,n  ; 

1  i  ^  1  1 

and 

(I  R1Z/n)1/2<|a1  <7  R,  ,  09) 

where,  t.  ,  i  =  l,2,***,2n  are  R^.  ,  (h  ,  i  =  l,2,*«*,n 
arranged  in  decreasing  order. 


(16) 

(17) 

(18) 


, .  '■*  y.  • '  . - 


*  :  8**‘  '  V-*7-*!Vt; 
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Proof:  An  application  of  the  Cauchy-Schwarz  inequality  yields 

R.  /  n^  £  C[  |a.  .|^)^  .  The  second  inequality  in  (16)  and 
1  i  1J 

the  inequality  on  the  left  in  (17)  follows  from  Theorems  11:4:4 
(1)  and  11:4:4  (6).  Further,  it  is  known  that  the  eigenvalues 
of  the  matrix. 


*  2 

are  +_  »  •  •  •  ,+  an  ,  for  if  AA  x  =  a  x  ,  then  setting 

1  * 

y  =  +  —  A  x  ,  we  have  Ay  =  +  ax  .  Thus  with  z'  =  (x,y) '  ,  we 
have 

Pz  =  (Ay, A  x)'  =  (j^ax,+ay)'  =  +  az  . 

Now,  the  inequality  on  the  right  in  (16)  and  inequality  (18) 

follow  from  (11)  with  x-  =  1  ,  1  £  i  £  n  .  Also,  with  a  =  1 

the  inequality  on  the  right  in  (19)  follows  from  (18)  as 

l  R.  =  l  C.  .  The  inequality  on  the  left  follows  from  (20) 
i  1  i  1 

below. 


(ii)  Given  A  , 

(I  R-j  /  n)2  1  I  R-j2  /  n  1  I  a-j2  =  tr  AA  llR-j2  •  (20) 


Proof: 


Since 


l  a.2  =  tr  AA 

i  i 


,  we  have 


.  Also,  l  R.2  =  l  (l  |a.,|)2  < 
i  1  i  j  10 

the  Cauchy-Schwarz  inequality. 


' 


V‘<  '  1  -  f'  •  v*'  ■ 
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Another  application  of  the  Cauchy-Schwarz  inequality  yields 

(l  Ri  /  n)2  £  l  R,2/  n  . 

i  1  1  1  □ 

(iii)  Given  A  , 

n  a.  <  n  R.  .  (21 ) 

i  1  i  1 

Proof:  From  Theorem  11:4:1  (1),  II  o.  =  | det  A|  .  Now  (21) 

i  1 

follows  from  (15). 

□ 
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§6:2 


In  this  section  we  shall  give  bounds  for  eigenvalues  when  the 
diagonal  elements  and  row  (column)  sums  are  known.  In  particular,  we 
discuss  the  diagonally  dominant  matrices: 

Definition  1:  Given  an  nxn  matrix  A  ,  if 

I a i  -i*  I  rl  I  lai-;l  ~  P-;  »  i  =  1 , 2 , •  •  • , n  ,  ( 1 ) 

11  jjM  10  1 

then  we  say  A  is  weakly  diagonally  dominant.  If,  all  the  inequal¬ 
ities  in  (1)  are  strict,  A  is  called  diagonally  dominant. 

□ 

Clearly,  one  may  also  define  diagonally  dominant  matrices  which 
involve  Qn-  's  instead  of  P.  's  ,  i  =  1 ,2,* ••  ,n  . 

Now,  we  give  the  bounds  for  the  eigenvalues.  We  note  that  all 
the  results  involving  (or  P. )  hold  for  C-  (or  Q. )  also. 

(a)  For  | A, |  =  max  |  A .  |  : 

1  i  1 

If  0  £  a  £  1  ,  then: 

|  A.,  |  £  max  (|aii|  +  P.a  Q^"06)  ;  (2) 

| A,  |  £  max  (| a.  .  |  +  aP.  +  (l-a)Q-)  , 

I  ^  1  I  T  ■ 

where  P.  and  Q.  are  given  by  0.(2). 

Proof:  See  [31,  pg.  151] . 


(3) 


□ 


:  •.  ,c»i  ov ■  s  ' t  ?!,v  nr  o .-’h>  v 

■ 

■ 


■ 
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(b)  For  U  |  =  min  | A . |  : 

\  /  1  n 1  .  1  l 1 

If  A  is  diagonally  dominant,  then: 

0  <  min( | a . . |  -  P.)  £  |X  |  .  (4) 

^  II  I  il 

Proof:  Inequality  (4)  is  immediate  from  the  Gerschgorin 1 s 
Theorem  below. 

□ 


The  following  result  is  given  in  [31,  pg.  159]: 

(c)  For  A.  : 

(i)  Let  A  be  such  that 

Re(a^- )  <  -Pi  ,  i  =  1 ,2,**-,n  .  (5) 

Then , 

Re(A. )  _<  0  ,  i  =  l,2,-**,n  .  (6) 

Further,  if  the  inequalities  (5)  are  strict,  then  so  are  the 
inequalities  (6). 

Proof:  If  X  is  any  eigenvalue  of  A  then  from  the  Gersch- 
gorin's  Theorem  below,  there  exists  1  <  i  <  n  such  that, 

Re(X)  -  Re(a.j . )  <_  P^ 

Now,  the  proof  follows  from  the  inequalities  (5). 

□ 


sk 

■  ■-’! 

-  •v."  . 
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(ii)  (Gerschgorin ' s  Theorem).  Let  P.  be  as  in  0  (2).  Then  every 
eigenvalue  of  A  lies  in  at  least  one  of  the  disks: 

I z  “  a i i  I  —  P i  »  i  =  1  >2,“*  ,n  ,  (7) 

in  the  complex  plane.  Furthermore,  a  set  of  m  disks  having  no 
point  in  common  with  the  remaining  n-m  disks  contains  exactly 
m  eigenvalues  of  A  . 

Proof:  If  is  an  eigenvalue  of  A  ,  then  det(A-XkI)  =  0 
Now  (7)  follows  from  the  Levy-Desplanques  Theorem,  below,  since 
A  -  XRI  cannot  be  diagonally  dominant.  Further,  in  case  a 
set  of  m  disks  (m<_n)  has  no  point  in  common  with  the  remain¬ 
ing  (n-m)  disks,  it  follows  by  the  continuity  argument  that 
this  set  contains  exactly  m  eigenvalues  (e.g.  see  [26,  pg. 


The  following  two  results  are  proved  in  [31,  pgs.  149-151]: 

(iii)  With  P..  ,  i  =  l,2,**«,n  ,  as  in  0  (2),  define  the  ^ 

oval s  of  Cassini , 


(z|  lz-aii  1 1 z  -  a j j )  <  PiPjJ  .  1.J  ■  1.2. -".n  .  1  *  i  ■  (8) 

Then,  each  eigenvalue  of  A  lies  inatleast  one  of  the  ovals. 

□ 


(iv)  Given  A  ,  each  of  its  eigenvalues  lies  on  or  inside  one  of 
the  disks. 


z-aii'  - 


<  P.a  0.1_a 


'1 


0  <  a  <  1 


1 ,2 , • •  •  ,n 


(9) 

□ 


. 

-  ^ 

■ 
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(f)  For  product  of  eigenvalues: 


(i)  (Levy-Desplanques  Theorem).  If  A  is  diagonally  dominant  then 
det  A  f  0  . 

Proof:  If  det  A  =  0  ,  then  the  system  Ax  =  0  has  a  nontriv¬ 
ial  solution  x  .  Let  lx.  I  =  max  | x - |  .  Then, 

k  .  i 


I  aki  xi 
j7k  J 


P 


k 


i  .e. 


kk 


<  P. 


onally  dominant. 


,  which  contradicts  the  fact  that 
Hence  det  A  f  0  . 


A 


is  diag- 

□ 


The  above  diagonally  dominant  assumption  can  be  weakened  for 
irreducible  matrices: 


(ii)  If  A  is  irreducible  and 

I  a  .j  .j  I  P  -j  >  i  =  l,2,««*,n  ,  (10) 

with  equality  in  at  most  (n-1 )  cases  then: 

det  A  f  0  . 


Proof:  See  [54] . 


n 


Below,  we  give  several  other  conditions  which  guarantee  the 
nonsingularity  of  A  . 


The  following  results  are  proved  in  [21,  pgs.  149  -  150]: 


' 


f>i 


1:6:2 
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aiil  aj j I  >  P,Pj  .  i.j  ■  1.2.—  ."  •  1  I*  J  - 


(11) 


then  det  A  f  0  . 


□ 


(iv)  Given  0  <  a  <  1  ,  if 


I  ~  r\  (X  /-*  1  “Ct  .  to 

ain- 1  >  pi  Q-j  ,  i  =  1 ,n  , 


(12) 


then  det  A  f  0  . 


The  following  result  is  cited  in  [2]: 


□ 


(v)  Let  R-j  =  P-j 


and 


i-1  R.  n 

Ri  =  X  |aitlfi-T+  .  I> 


t=l 


tt l  t=i+l 


i  t 


,  i  =  2 , 3 ,  •  •  • ,  n 


(13) 


If, 


aii I  >  Ri  >  1  =  1.2, ...,n  , 


then  det  A  f  0  . 


(vi)  If  (v)  above  holds  and  for  2  <  i  <  n  , 


□ 


i-1  R. 

£i  =  X  |aid  HTT  and  Li  = 


t=l 


tt 


-1  |  r  |  | 

a  a  )  a,  .  , 

i!  11  1  t=f+]1  It1’ 


t  =  i+1  ,  then 


. 
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n 

all  I  .?2  ( I ai i I “£i+Li )  1  ldet  Al 

lUnl  j2  (laiil«-Li)  •  H4) 


Proof:  See  [2] . 

□ 


(vii)  If  a . .  =  1  ,  P .  <  1  ,  p  =  max  P.  <  1  and  P  =  T  P.  then: 

ii  i  i  .  i 


eP(l-p)P/p  £  | det  A|  .  (15) 


Proof:  See  [7,  pg.  71] . 

□ 


(viii)  If  A  is  diagonally  dominant  then: 


| det  A |  £  n  d  .  , 

j  3 

where  d.  =  |a..|  -  P.  . 

vJ  *J  vJ  J 


Proof:  See  [26,  pg.  228]. 

□ 


(g)  For  singular  values: 


(i)  Given  A  , 


max(R/n^  , 


max  | a . .  | )  £  a, 

ill  i 


(16) 


Proof:  The  proof  is  immediate  from  0  (16)  and  2:0  (3) 


□ 


.J 
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The  following  results  are  proved  in  [281: 


(ii)  Let  A  be  an  m><n  matrix.  Define: 

k  .  |  a .  .  |  k  . 

r,  =  I  J|,  1  j  ,  c.  =  l  yJ-  |a  .,|  ,  1  =  1,2,-**  ,min(m,n)  . 
1  l  1  j*i  Ki  J1 


s.  =  max(r. ,c.)  ,  a*  =  la.  *  I  and 

i  i  i  '  9  i  'n1 

n  k  .  |  a .  .  | 

max  l  -1--  ,  for  m  >  n 

n+l<i<m  j=l  Ki 


m  k  .  |  a  .  *  I 

max  l  ,  for  m  <  n  , 

m+l<i<n  j=l  Ki 

where  k.  >  0  ,  i  =  1 ,2, • • • ,max(m,n)  are  any  positive  numbers 
and  a+  =  max(0,a)  ,  for  any  real  a  . 


Then  each  singular  value  of  A  lies  in  one  of  the  intervals: 


Bi  =  [(ai-si)+  ,  a.j+s.j]  ,  i  =  l,2,*»«,n  , 


Bn+1  ~  * 


If  m  =  n  or  if  m>  n  and  a.  >_  s-+s  ,  i  =  l,2,***,n  ,  then 
B  +*|  is  not  needed  in  the  above  statement.  Furthermore,  every 
interval  of  the  union  of  ,  i  =  l,2,***,n+l  (n  for  m=n)  , 
contains  exactly  k  singular  values  if  it  contains  k  inter¬ 
vals  of  B*|  ,Bn  . 


n  >  rn  t 

•:  ■  i  'i  n)  ,  *  • , 
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(iii)  In  (ii)  B.  =  l,2,***,n  can  be  replaced  by 

G-j  =  I^n-+  5  »  i  =  l,2,*««,n  , 


where 


for  i  =  l,2,***,n  ,  where  if  one  of  the  numbers  in  the  mini¬ 
mum  is  not  real,  we  omit  it. 


(h)  For  the  condition  number: 

If  A  is  diagonally  dominant  then: 

max  R .  /  min  R.  <  c(A)  .  (17) 

i  1  i  1  ~ 

Proof:  Since  A  is  diagonally  dominant  the  Levy-Despl anques 
Theorem  implies  that  det  A  is  nonzero.  Thus,  an  >  0  . 

Now  (17)  is  clear  from  0  (16)  and  0  (17). 

□ 


r  :  frr  '■  a  *  «i  *h*c  , ,  „  »•*,{«  .  i, ••  •  ,S,  *  r  *iot 


fftwgfe  tn<&c$&*b  ft  a 
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§6:4 


In  this  section  we  shall  give  bounds  which  involve  only  row 
* 

sums  and  tr  AA  . 

(e)  For  sum  of  eigenvalues: 

Define, 


’ .  =  y  a . . 

i  4  ij 


c .  =  y  a  . . 
1  j  J1 


p  =  ^(  l  |c,-ck|2)1/z  and  q.l(I  |r-r  |2)1/2 
n  i<k  1  K  n  i<k  1  K 


For  any  matrix  A  , 

l  I*,!2  <  INI2  -  (p-q)2  .  (1) 

i  1 

In  fact  p  =  | | PAQ | |  and  q  =  | |QAP| |  ,  where,  P  =  1  J  , 

Q  =  I-P  and  all  the  elements  of  J  are  one.  Further,  if 
pq  f  0  then  equality  holds  in  (1)  if  and  only  if, 

CQ  =  PAP  +  QAQ  +  (^)1/2  PAQ  +  (^)1/2  QAP 


is  normal  while  if  pq  =  0  equality  holds  in  (1)  if  and  only 
if,  Co  =  PAP  +  QAQ  is  normal. 


Proof:  See  [25]. 


□ 


(f)  For  product  of  eigenvalues: 

Let  a. j  =  1  ,  P.  <  1  ,  i  =  l,2,*«*,n 


5 


[h  *  paw s  &)  *  yAo  ♦  m  •  ^ 


< 
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p  =  max  P.  ,  P  =  l  P. 

•I  •  : 


t  =  tr  A  A  -  n  and  q  =  max 


Then : 

e^P/P^l-pJ^P/P2  <  et/p(l-p)t/p2  < 


|  det  A | 


Proof:  See  [7,  pg.  72]. 


□ 
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§6:5 

Given  the  row  sums  R.  ,  and  | |AA  -  A  A | |  we  have  the  follow¬ 
ing  bounds  for  the  sum  of  eigenvalues: 

(e)  For  sum  of  eigenvalues: 

•k  k 

Given  D  =  AA  -  A  A  ,  we  get 

l  R^/n  -  IlDllil  |2 

i  ((I  R,2)2  -  i  IlDll2)172  •  0) 

i  1  ^ 

Proof:  Inequality  (1)  is  immediate  from  0  (20),  5:4  (1)  and 
5:4  (3). 

□ 


i  )•: 


CHAPTER  7 


DETERMINANT 


§7:0  Prel iminaries. 


as. 


Given  A  ,  the  determinant  of  A  ,  written  det  A  ,  is  defined 


det  A  =  Y  sgn  a  n  a  , . N .  ,  (1 ) 

creS  i  o(l)l 

n 

where  Sn  ,  is  the  symmetric  group  of  order  n  and  sgn  a  is  one  if  a 
is  an  even  permutation  and  negative  one  if  a  is  an  odd  permutation.  It 
can  be  shown  that  det(A-AI)  =  (-l)nAn  +  (-1  )n~^  c-|  An’'1  +  (-1  )n-2C2^n"^  + 
•••  +  c  ,  where  c  is  the  sum  of  all  the  principle  minors  of  order  r 
of  A  ,  1  £  r  £  n  (e.g.  see  [26,  pg.  54]).  Thus,  taking  X  =  0  ,  we  get 


det  A  =  c  =  A  A0  •••  A  ,  (2) 

n  1  2  n 

since  cr  is  also  the  sum  of  all  products  of  the  n  eigenvalues  of  A 
taken  r  at  a  time.  Alternatively,  since  the  determinant  of  a  triangu¬ 
lar  matrix  is  the  product  of  its  diagonal  elements,  and  since  similar 
matrices  have  the  same  determinant,  (2)  also  follows  from  Schur's  triangu- 
larization  Theorem. 


Now,  we  give  the  results  which  involve  only  det  A  . 

(a)  For  |A  |  =  max  | A. |  : 

i  ' 

Given  A  , 


65 


'1  '  U  .  '  C  .(•?  -• 


■ 

•  ,  TU  -ir-ls:  .  -’'M  9  ST'  J  - 
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| det  A|1/n  <  |A1 |  .  (3) 

When  A  is  normal,  equality  holds  if  and  only  if  A  =  cU  , 
for  some  scalar  c  and  unitary  U  . 

Proof:  Inequality  (3)  is  immediate  from  (2).  The  equality 
conditions  follow  from  Theorem  11:0  (6). 

□ 


(b)  For  |X  I  =  min  I  A. 
7  1  n 1  .  1  i 

Given  A  , 


|A  |  <  | det  A|1/n  .  (4) 

i  ni  _  i  i 

When  A  is  normal,  equality  holds  if  and  only  if  A  =  cU  , 
for  some  scalar  c  and  unitary  U  . 


Proof:  Inequality  (4)  is  clear.  The  equality  conditions 
follow  from  Theorem  11:0  (6). 

□ 


(e)  For  sum  of  eigenvalues: 

Given  A  , 

n  | det  A | a/n  ^  |x.|a  ,  a  _>  0  .  (5) 

l  1 

For  normal  A  ,  equality  holds  if  and  only  if  A  =  cU  for 
some  scalar  c  and  unitary  U  . 
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Proof:  Inequality  (5)  follows  by  an  application  of  the  arith¬ 
metic-geometric  mean  inequality  to,  | det  A|a=  | | 06 1 | 06  ••• 
jAj01  j  a  >_  0  .  Equality  holds  in  (5)  if  and  only  if 
l^]l  =  1^1  =  ”*  =  l^nl  »  which  for  normal  A  happens  if  and 
only  if  A  =  cU  ,  for  some  scalar  c  and  unitary  U  (see 
Theorem  11:0  (6) ) . 


□ 


(f)  For  product  of  eigenvalues: 


Given  A  , 


A-j  ^2  ***  ^n  =  de^  A 


(6) 


□ 


(g)  For  singular  values: 


Given  A  , 


| det  A|  £  a-|  ; 


(7) 


ap  <  | det  A|1/n  ; 


(8) 


al  °2  ***  an  =  ldet  ’ 


(9) 


n  | det  A|a/n  <  £  a.a 

i  1 


,  a  >  0 


(10) 


Equality  holds  in  (7)  if  and  only  if  equality  holds  in  (8)  if 
and  only  if  equality  holds  in  (10)  if  and  only  if  A  =  cU  for 
some  nonnegative  c  and  unitary  U  . 


•  v\ 
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Proof:  From  Theorem  11:4:1  (1)  we  have  Idet  A|  =  a,a0*»«a  . 

-  '  1  1  1  2  n 

Now,  inequalities  (7)  and  (8)  are  clear.  Inequality  (10)  follows 
from  the  arithmetic  -  geometric  mean  inequality.  Further,  equal¬ 
ity  in  (7)  or  (8)  holds  if  and  only  if, 

al  =  °2  =  ***  =  an  =  ldet  Al'*,/n  •  (11) 

Further,  equality  in  (10)  holds  if  and  only  if  (11)  holds.  How¬ 
ever,  if  (11)  holds,  then  from  the  Singular  value  decomposition 
theorem  (see  Theorem  11:4:0  (4)),  A  =  UV  .  The  converse  is 
trivial . 

□ 
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§7:1 


If  det  A  and  tr  A  are  known,  then  results  of  Section  0  and 


1:0  can  be  combined  to  yield  improved  bounds  for  the  eigenvalues  and  the 
singular  values  of  A  .  In  addition  the  following  lower  bound  for  c ( A) 
holds : 

(h)  For  the  condition  number: 

If  det  A  f  0  then: 


(1) 


For  normal  A  ,  equality  holds  in  (1)  if  and  only  if  A  is  a 
scalar  matrix. 

Proof:  Inequality  (1)  is  clear  from  0:  (8)  and  1:0  (7). 

Further,  for  normal  A  ,  if  equality  holds  in  (1)  then  necessar¬ 
ily  | A-j  |  =  | tr  A |  /  n  ,  which  implies  A-j  =  •••  =  An  .  Now 
from  the  Theorem  11:0  (7),  A  must  be  a  scalar.  The  converse 
is  clear. 


□ 


'.‘.ii  -  '  - r *  l* 

. 
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§7:2 

Given  det  A  and  the  diagonal  elements  of  A  ,  results  of 
Sections  0,  1,  1:0  and  2:0  hold.  In  addition  the  following  result  for  the 
condition  number  holds: 


(h)  For  the  condition  number: 


If  det  A  f  0  then,  a  >  0  and 

n 


n  max  a . .  i ,  i 

i  1  n 1  lAi  I 

1  <  — - - - -  <  — — r  <  c (A)  , 


tr  A 


A 


n 


provided  tr  A  f  0  . 


(1) 


Proof:  Since  det  A  =  Ict,  •••  o  I  (see  Theorem  11:4:1  (1)), 
det  A  f  0  implies  an  >  0  .  Now,  (1)  follows  from  1:0  (4) 
and  2:0  (3). 

□ 
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7:3 

2 

If  det  A  and  tr  A  are  known  then  the  results  of  Section  0 
and  3:0  hold.  In  addition  if  det  A  is  non-zero,  we  have  the  following: 


(h)  For  the  condition  number: 

If  det  A  f  0  ,  then: 


(I 

tr 

A2 

[>]'*  J 

172, 

n 

det  A 

1/n  -  | 

A  1 

n 1 

<  c(A) 


(1) 


Proof:  The  proof  is  immediate  from  3:0  (2)  and  0  (4) 


□ 


1:7:4 
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§7:4 


In  this  section  we  shall  give  results  which  involve  det  A  and 


* 


tr  AA  .  Their  proofs  involve  the  use  of  the  arithmetic  -  geometric  mean 
inequality.  Wittmeyer  and  Wegner  used  the  same  idea  to  derive  bounds  for 
a  real,  positive  definite  matrix  (see  [7,  pg.  69]). 

(a)  For  I X-,  |  =  max  |  A  •  |  : 

1  i  1 

Given  A  , 


(1) 


Proof:  Applying  the  arithmetic  -  geometric  mean  inequality  to 


I ^2 1 ^  *  I ^3 1 ^  ’  *  *  * ’ I ^n I ^  ’  We  have’ 

y  I A  .  I  2  -  I A  J  2 


r  i  i  ?  * 

Now  i  | A . ] -  <  tr  AA  implies  the  inequality  on  the  left,  as 
i  1  ~ 

| det  A|^n  <_  | A1  |2  .  Also,  solving  for  the  second  |A.||2 

in  (2) ,  we  obtain, 


(3) 


which  yields  the  inequality  on  the  right,  since 


|X-||2  1  l  IX.I2  <  tr  AA*  . 


□ 


J.\  >  3iA  1ST!  1  L 


.ypory 


36  ,^9f  art.  no  yjrlsLpinr  sdj  a? r fam  f  *A4  iJ  :f/.'  V 
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(b)  For  | X  |  =  min  |A.  |  : 


Given  A  , 


f'-— I det  A|2  <  |A  |2  <  tr  AA*  -  (n-1)  | det  A| 2/n  .  (4) 

Hr  AA  '  n 


Proof:  If  =  0  then  (4)  is  clear.  In  case  X^  f  0  ,  apply¬ 
ing  the  arithmetic  -  geometric  mean  inequality  to 


2  2  2 
I  ,I*2I  »***» l^n-i I  9  we  have’ 

l  l\'l2- 


| det  A|  <  |A 


2  i 


n-1 


< 


i\ 


2  /  tr  AA 


n-1 


n-1 


which  establishes  the  left-hand-side  inequality.  Now,  if 
An  =  0  ,  then  the  inequality  on  the  right  holds.  Let  X^  f  0  . 
Then 


and  | X  | ^  £  | det  Al^11  ,  yields  the  right-hand-side  of  (4). 


□ 


(c)  For  |Xk |  : 

Given  A  ,  for  1  £  k  £  n  , 

|A .|2  <  tr  AA*-(n-l)7k.'n;ll-V/n~1  . 

v  tr  AA  ) 

Proof:  As  in  the  proof  of  inequality  (4),  the  arithmetic - 


geometric  mean  inequality  gives. 


tgvbf  *w  f  u  r  r  -t  r  -'  ■  r  '  & «  -  » 
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o  ★  9  * 

Now  using  £  |X.p  <  tr  AA  ,  we  get  |X.  \  <  tr  AA  /k  ,  which 

i  i  -  k 

together  with  the  above  inequality  proves  (5). 

□ 


(d)  For  the  spread: 


Given  A  , 


,trAA*-|det  A|2/") 

-  {tr  AA  -(n-1)  | det  A| 2//n}  ^  £  sp (A) 


(6) 


Proof:  Inequality  (6)  is  immediate  from  (1)  and  (4). 


(g)  For  singular  values: 


□ 


Given  A  , 


tr  AA  -  | det  A| 


<  tr  AA 


\n-l  .  ,2 

m)  |detA|  -°i 

.  (n-DfidetA liV/n-1 
\  tr  AA  J 


tr  AA  / 


(7) 


n~~*  | det  A|  2  £  an2  £  tr  AA  -  (n-1)  | det  A|^^n  ; 


(8) 


and , 


2  £  tr  AA*  -  (n-1 )  (  ^  P det-  ) 

\  tr  AA  / 


2  \  1 /n-1 


(9) 


r-fi* 


i  ~r 


- 


t 
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2  * 

Proof:  Since  |det  A|  =  a-j  a ^  •••  crn  and  £  a..  =  tr  AA  , 

the  above  inequalities  can  be  proved  with  the  arguments  similar 
to  those  used  to  prove  (1),  (4)  and  (5). 

□ 

(h)  For  the  condition  number: 

Given  A  ,  if  det  A  f  0  ,  then: 

_ (n~l)n~- _  <  c2(a) 

(tr  AA*-  | det  A| 2/n)n_1  P 

(tr  AA*)11'1  {tr  AA*  -  (n-1 )  ( !  -de--A-4) 1  /n~1  > 

<  _ tr  AA _ 

(n-1 )n  ^  | det  A|^ 

where, 

p  =  min(tr  AA  /n  ,  tr  AA  -  (n-1)  | det  Al^11) 


Proof:  Proof  follows  from  the  inequalities  (1),  (4)  and  the 

fact  that  a  ^  <  tr  AA  /  n  . 
n  — 


□ 


"  ' 
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§7:5 

* 

Given  det  A  and  | |AA  -A  A||  we  have  the  following  result: 

(h)  For  the  condition  number: 

Given  A  ,  if  | det  A|  t  0  ,  then: 


2 


lAA*-A*All 

^  n  | det  A| 


2/n 


<  c"(A) 


(1) 


Proof:  Inequality  (1)  is  immediate  from  5:0  (2)  and  7:0  (8). 

□ 


. 
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§7:5.4 


In  this  section  we  shall  give  results  which  involve  det  A  , 

ic  ie 

tr  AA  and  | |AA  -A  A||  .  Their  proofs  run  along  the  same  lines  as  of 
those  proved  in  7:4,  except  that  now  we  use  the  inequality  5:4  (1),  which 
says, 

l  |Xi|2iq  -  (||A||4  -  1  |  |AA*-A*AM)1/2  ,  (1) 

2  2 

instead  of  I  |X.  |  <_  ||A||  .  We  shall  thus  omit  these  proofs. 


(a)  For  | A, |  =  max  | A. |  : 

I  •  '  i 


With  q  as  given  by  (1), 


( 


n-1 


q  -  | det  A | 


2/n 


■^n~1|det  A|2  <  |A1 


< 


.(n.1)(MelAj 1,1/n-l 


(2) 

□ 


(b)  For  | An|  =  min  | A^ | . 

With  q  as  in  (1), 

idet  A[2  <  |An|  <  q  -  (n-1)  idetA|2/" 


(3) 

□ 
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(c)  For  |Xk 


Given  A  , 


\K\  <  q  -  (n-l)( 


k  1  det  Al2)  1/n-l 


»  k  1 ,n 


where  q  is  as  defined  by  (1). 


(4) 


□ 


(d)  For  the  spread: 

Given  A  and  q  as  above, 

( . (n'1)'  2/-n-  I1/2  -  {q  -  (n-1 )  I  det  A|2/n}1/2  <  sp(A)  .  (5) 

l(q  -  | det  Ap/n)  J 

□ 
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§7:6 


Given  the  row  sums. 


Ri  ?  Iai4  ’ 


we  have 


I  K-l2 1  y  =  I  R.j2  -  (p-q)2 

i  1  i  1 


(1) 


(2) 


where,  p  =  1  (  l  |c  -c.|2)  ,  q  =  (  I  \r.  -r  |2)1/2  ,  c.  =  I  a.. 

n  i<k  1  K  n  i<k  1  K  1  j  J1 


and 


r.  =  l  a.,  (see  6:0  (12)).  Thus,  all  the  results  of  7:4  hold  with 

^  4  1  J 


j* 

tr  AA  replaced  by  y  as  defined  by  (2).  In  addition  we  have  the  fol¬ 
lowing: 

(h)  For  the  condition  number: 


Given  A  ,  if  det  A  f  0  ,  then: 


max  R. 

l 


n1/2l|det  Al1/"  -  C(A)  ' 


Proof:  The  proof  is  clear  from  6:0  (16)  and  7:0  (8)  . 


□ 


•'  !•)  i  >  ;•« 


'  i.; 


f  Q  ^  A  J$b 


/  Kt» 
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CHAPTER  8 


REAL  EIGENVALUES 


i8 : 0  Prel  iminaries. 

Given  the  matrix  A  ,  its  eigenvalues  need  not  be  real.  Even 
if  A  is  real,  all  its  eigenvalues  can  be  complex.  However,  there  exist 
matrices,  which  have  real  eigenvalues.  For  example,  if  the  order  n  of 
a  real  matrix  A  ,  is  odd  then  at  least  one  of  its  eigenvalues  is  real. 
Also,  it  is  well-known  that  all  the  eigenvalues  of  a  Hermitian  matrix 
are  real . 

Below,  we  state  some  necessary  and  sufficient  conditions  for 
m(<_n)  eigenvalues  of  A  to  be  real.  The  proofs  can  be  found  in  [12]. 

Theorem  1 :  If  A  has  m  distinct  real  eigenvalues,  then  there  is  a 
positive  semi  definite  matrix  S  of  rank  m  such  that  AS  =  SA  ; 
conversely,  given  any  such  S  ,  then  A  must  have  at  least  m  real  eigen¬ 
values,  and  if  m  =  n  ,  then  A  is  diagonal izable. 

□ 

Theorem  2:  Given  A  =  (a..,.)  ,  let  r_.  =  T  a.,.  ,  i  =  l,2,«**,n  .  Define 

I J  "I  k  1 K 

an  nxn  matrix  E  =  (e..)  ,  e.  .  =  r.  -F.  and  suppose  that 

■  J  ^0  J 

A*  -  A  =  cE  , 

for  some  real  c  >  -  —  (or  c  >_  -  if  A  has  real  trace  or  real  non¬ 

zero  determinant).  Then  A  has  all  its  eigenvalues  real  (and  A  is 
diagonal  izable  if  c  f  -  ~).  n 
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Since  the  eigenvalues  A.  ,  i  =  1 ,2,* • •  ,n  ,  of  A  are  given 
to  be  real  in  this  chapter,  we  shall  always  assume  (unless  otherwise 
stated)  that  they  are  ordered  as: 


A1  i  X2  i  —  An 


•  •  • 


(1) 


’ 
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§8:1 

In  this  section  we  shall  give  bounds  for  eigenvalues  which 
involve  only  tr  A  and  n  . 


(a)  For  A-j  =  max  A.  : 


Define, 


Then 


m  =  tr  A  /  n 


m  £  A-j 


Equality  holds  in  (2)  if  and  only  if: 


A,  =  A0  =  • • •  =  A 
1  2  n 


Proof:  Trivial. 


(b)  For  A  =  min  A.  : 

n  i  i 

Given  m  as  in  (1), 

A  <  m  . 

n  — 

Equality  holds  in  (4)  if  and  only  if  (3)  holds. 
Proof:  Trivial. 


(1) 

(2) 

(3) 

□ 

(4) 

□ 


ill 


arm  * 
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§8:3 

Let  the  eigenvalues  of  A  be  ordered  as 

hi  i  hi  -  ■"  -  lxnl  • 

2 

Given  tr  A  ,  using  the  fact  that  the  eigenvalues  of  A  are  real  we 
obtain  the  following  results: 

(c)  For  |Xk|: 

Given  tr  P?  , 

|Xk|  <  (tr  A2/  k)1/2  ,  k  =  1,2, •••,(!  .  (1) 


Proof:  Trivial. 


□ 


(f)  For  product  of  eigenvalues 


Given  tr  A  , 


(det  A)^11  <  tr  A^  /  n 


Equality  holds  in  (2)  if  and  only  if: 


Xn  =  X0  -  •••  =  X 
2  n 


(2) 


(3) 


Proof:  The  proof  follows  at  once  by  an  application  of  the 

2 

arithmetic  -  geometric  mean  inequality  to  X.  ,  i  =  l,2,***,n. 


□ 


?duff>vfJ5ia-fa  9fl9  9-11  gtflfaii  e 


? 


■■ 
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(g)  For  singular  values: 

Given  tr  A2  , 

0 

n 

i  l*nl 

£  (tr  A2  /  n)1/2  ; 

(4) 

<°i 

Cr,  *•* 

an)2/n  i  tr  A2  /  n  ; 

(5) 

tr 

A2lK-2  • 

(6) 

Proof:  Inequalities  (4)  and  (5)  follow  from  Theorem  11:4:1 
(1)  and  the  inequalities  (1)  and  (2)  respectively.  Inequality 
(6)  follows  using  Theorem  11:4:1  (1)  and  the  fact  that 
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§8:3.1 

Many  localization  results  can  be  obtained  using  the  tr  A  , 

2 

tr  A  and  the  fact  that  the  eigenvalues  of  A  are  real.  A  family  of 
such  results  is  derived  in  [37]  and  [63]. 

All  the  results  to  follow  are  proved  in  [37]  and  [63].  We 
shall  omit  their  proofs.  We  shall  need  the  following  notation: 

m  =  tr  A  /  n  and  s^  =  tr  A^  /  n  -  m^  .  (1) 

(a)  For  A,  =  max  A.  : 

1  i 

With  m  and  s  as  in  (1), 

m  +  s(n-l  )-^2  £  A-j  £  m  +  s(n-l  .  (2) 

Equality  holds  on  the  left  (right)  if  and  only  if  the  (n-1) 
largest  (smallest)  eigenvalues  of  A  are  equal. 

Proof:  See  [63] . 

□ 

(b)  For  Ap  =  min  A.  : 

i 

With  m  and  s  as  in  (1) 

m  -  s(n-l  )"*^  £  An  <_  m-s/(n-l  )"*//^  .  (3) 

Equality  holds  on  the  left  (right)  of  (3)  if  and  only  if 
equality  holds  on  the  left  (right)  of  (2). 

Proof:  See  [63] .  n 


c  !.4>:  •  (S2B  l  i  J  i  '  3?  b 


,  • 
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(c)  For  X.  : 


Given  A  , 


m 


_t  k-l  J/2  ^  _ j  „,n- k\l/2 

'^ThST*  iAkim  +  s(— ) 


(4) 


Equality  holds  on  the  left  of  (4)  if  and  only  if 


A1  =  "•  =  Ak-1  and  Ak  =  "•  =  An 


(5) 


and  on  the  right  of  (4)  if  and  only  if 


X1  =  •••  =  Ak  and  Xk+1 


=  X 


n 


(6) 


Proof:  See  [63J . 


(d)  For  the  spread: 


Let  s  be  given  by  (1).  Then: 


□ 


2s  <  sp(A)  <  (2n)^2s 


(7) 


When  n  >  2  ,  equality  holds  on  the  right  if  and  only  if 


X 


2  =  A3  =  •"  =  An-1  =  \  (A1+An)  • 


(8) 


In  case  n  is  even,  say  n  =  2q  ,  then  equality  holds  on  the 
left  of  (7)  if  and  only  if 


A1  ~  A2  "  Aq  and  Aq+1  Aq+2 


=  X. 


(9) 


Furthermore,  if  n  is  odd,  say  n  =  2q+l  ,  then: 


*  -  - 
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2s  n/(n2-l)1/2  <  sp(A)  .  (10) 

Equality  holds  in  (10)  if  and  only  if  (9)  is  true. 

Proof:  See  [631. 


(e)  For  sum  of  eigenvalues: 


(i )  If  we  define. 


£ 


A(M)  =  *-k+l  l  \j 

2 

and  m  and  s  as  in  (1),  then: 


(ID 


(12) 


For  (k ,£)  =  (l,n)  ,  (12)  collapses  and  equality  always  holds. 
When  (k,£)  f  (l,n)  equality  holds  on  the  left  of  (12)  if  and 
only  if 


A1  -  X2 


=  Xk_,  and  Ak  =  Ak+1 


—  •  • 


=  X 


(13) 


and  on  the  right  if  and  only  if 


A1  X2  ~  **’  "  A£  and  A£+l  A£+2 


=  A 


(14) 


Proof:  See  [63J . 


□ 


(ii)  If  k  = 


or  £  =  n  ,  the  bounds  for  A^  ^  can  be  improved: 


I 


■ 


■ 
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(  m  + 


A 


(1,*)  ~  \ 


(n-1 ) 


1/2 


if  £<£ 


m  + 


s(n-&) 


(n-1) 


1/2 


if 


(15) 


A 


m  - 


s(k-l) 


(n-k+1 ) (n-1 ) 1/2 


(k,n)  -  \ 


m  - 


(n-1) 


1/2 


if  k<i+l 


if  k  >  |  +1 


(16) 


Equality  holds  in  (15)  if  and  only  if 


X.  =  Art  =  •  •  •  =  A  _ 
1  2  n-1 


when  i  <  S- 


X1  A2  -  ...  ^n-1  0r  X2  =  X3 


•  •  •  — 


An  when  i  =  j  (17) 


A  =  A  =  •  •  •  =  A 
2  3  n 


when  l  >  7)-  . 


Equality  holds  in  (16)  if  and  only  if 


X1  X2  "  Xn-1 


when  k  <  7T  +  1 


A,  =  A0=  •••  =  A  ,  or  A0  =  •  •  •  =  A  when  k  =  5-  +1  (18) 

2  n-1  2  n  2 


A0  =  A.  =  • • •  =  A 
2  3  n 


when  k  >  S-  +1 


Proof:  See  [63] . 


□ 


■ 
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(iii)  With  m  and  as  before. 


Ak  ‘  AJt  -  s  n1/2  ^k  +  n-£+l  ^  /2  ’  1lk<£in 


(19) 


Equality  holds  if  and  only  if. 


A1  =  A2 . Ak 


Ak+1  =  Ak+2 


—  •  • 


=  =  tr  A  /  n 


(20) 


Xi  ”  X£+l 


An  • 


Proof:  See  [63] . 


□ 


(f)  For  ratios  of  eigenvalues 


(i)  Define, 


Yk£  =  xk/x£  »  l<k<£<n  , 


and 


c  = 


 (tr  A)' 


tr  A‘ 


-  (£-d  . 


(21) 


(22) 


If  tr  A  >  0  and 


(£-1 )  tr  A^  <  (tr  A)^  , 


(23) 


then: 


Xi  >  0  9 


and 


. 


.  ■  'r_ 


3H  6  -  0,<  A 
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c  +  k  +{  n~y+~*-  (c+k)  (n-JM-l-c)}"*/2 

Yk£  - - 

c  +  k  - ( —f+T  (c+k)(n-£+l-c)}1/2 

Further,  equality  holds  in  (24)  if  and  only  if 


(24) 


•  •  •  =  A. 

k 

A^_-|  =  tr  A2  /  tr  A  , 

•  •  •  =  A 

n 

Proof:  See  [37J . 

Remark  1 .  For  i  =  k+1  ,  (24)  yields: 

m  x  <./n-k\  1/2 

m  +  s(— j^— ) 

Xk/Xk+1  1  , /n-kxl/2 

m-  s/(— ) 

with  equality  if  and  only  if 

A1  =  A2  =  •••  =  Ak  and  Ak+]  =  Ak+2  =  An  • 

( i i )  Def i ne , 

6k£  ~  Ak+A^  *  1lk<^ln  • 

If  tr  A  0  and  for  t  =  max(k,2£-n-l )  , 

(t-1)  tr  A2  <  (tr  A)2  . 


Ai  =  A2  = 


Xk+1  '  Xk+2 


—  •  •  •  — 


A«.  ’  A«,+l 


(25) 


□ 


(26) 


□ 


(27) 


(28) 


Then: 


/  *  “  r 


. 
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Ak  +  A£  >  0  ’ 
and 

^  <  {(c+k)  (n-£+l -c)}^^  (n-H+l+k) _  ^g) 

^  2(c+k){k(n-£+l )}  ^  +  {(c+k)(n-£+l-c)}  ^(n-£+l-k) 

where  c  is  given  by  (22).  Equality  holds  if  and  only  if 
(25)  holds. 

Proof:  See  [37] . 

□ 


(iii) 


Given  k  >  1  (or  £<n)  the  best  lower  bound  for  6k£  is  0  . 
If  k  =  1  and  i  =  n  then  for  tr  A  >  0  ,  we  have: 


2m(n-l)1/2  +  s(n-2)  1  6ln 

where  m  and  s  are  as  given  by  (1). 
only  if 


,  (30) 

Equality  holds  if  and 


X 


2 


Proof:  See  [37] . 


□ 


(iv)  With 

(k  A.  +  (n-£+l)  A.)2 

nk()  =  - o - o-  ,  l<k<£<n  (31) 

k^  +  N+DA/ 


and  k  X^  +  (n-£+l)  X^  >  0  ,  then: 


if  tr  A  >  0 


/ 
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(tr  Af  -  (a-k-1)  <  n.  .  (32) 

tr  A  K* 

Equality  holds  if  and  only  if  (25)  holds. 

Proof:  See  [37] .  n 


(v)  Given  A  , 


(tr  A)1 

tr  A2 


-  n  +  2  < 


“  A  2+A  2 
!  n 


(33) 


For  n  >  2  ,  equality  holds  if  and  only  if  A-j  +  A  f  0  and 


X2  ~  X3  " 


=  A 


n-1 


2  2 
A/  +  A  ^ 
_  1  n 

A.  +  A 
1  n 


Proof:  See  [63] . 


□ 


(g)  For  singular  values: 

2 

Given  m  and  s  as  in  (1), 

m  +  s/(n-l  )1/2<a1  .  (34) 

When 

tr  A  >_  0  and  (n-1)  tr  A2  <  (tr  A)2  ,  (35) 

then : 

an  <  m  -  s  /  (n-1)1/2 


(36) 


,  L.ii:  ,  <;  +  2ti 


/ 


*(.'}  ill  26  b nfi  m  aevfO 

\ 
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Further,  if  A  is  Hermitian  then  An  >  0  implies  that  A  is 

positive  definite.  Also,  then  equality  holds  in  (34)  if  and 
only  if, 

A1  =  X2  =  •"  =  Vl  ’ 

and  equality  holds  in  (36)  if  and  only  if 

A  =  A  =  •••  =  A 
2  3  n 

Proof:  Inequality  (34)  follows  from  (2)  and  Theorem  11:4:1  (1). 

Also  the  inequalities  (3)  and  (35)  imply  that  An  >  0  .  Thus, 

from  Theorem  11:4:1  (1),  a  <  A  and  (36)  follows  from  (3). 

n  —  n 

Finally,  if  A  is  Hermitian  then  Ap  >  0  implies  that  A  is 

positive  definite,  which  in  turn  implies  that,  cr..  =  A.  , 
i  =  l,2,***,n  (see  13:0  (11)).  Thus  equality  conditions  fol¬ 
low  from  the  equality  conditions  in  the  inequalities  (2)  and 
(3). 

□ 


(h)  For  the  condition  number: 

If  tr  A  0  and  c  >  0  ,  where 

c  =  (tr  -  (n-1 ) 
tr  A 

then : 


o  <  m  +  <  c(A) 

m  -  s  /  (n-1 ) '  ^ 


(37) 


/*»*'#  A  «  J, 

r 


tbrtOD  ^rfffiupp  »r3  if 


•  ■  '-  i(  >1  ]■■■;■  HJn  ( " ) 


■ 
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In  case  A  is  Hermitian,  equality  holds  in  (37)  if  and  only 
if  A  is  a  positive  scalar  matrix. 


Proof:  The  proof  is  immediate  from  inequalities  (34)  and  (36). 

□ 


1:8:4 
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§8:4 

* 

Given  tr  AA  and  that  all  the  eigenvalues  of  A  are  real, 
in  addition  to  the  results  of  4:0,  we  have  the  following  result: 

(e)  For  sum  of  eigenvalues: 

Given  tr  AA  , 

tr  A2  =  l  A . 2  <  tr  AA*  .  ( 1 ) 

i  1  “ 

Equality  holds  if  and  only  if  A  is  Hermitian. 

Proof:  Since  the  eigenvalues  are  real,  (1)  is  clear  from  4:0 
(9).  Also,  we  have  that  equality  in  (1)  holds  if  and  only  if 
A  is  normal.  Thus,  the  result  will  follow,  if  we  can  prove 
that  a  normal  matrix  has  real  eigenvalues  if  and  only  if  it 
is  Hermitian.  Sufficiency  is  clear.  To  prove  the  necessity, 
we  write  A  =  UDU  ,  where  U  is  unitary  and 
D  =  diag(A^  9X^9  •  •  •  ,A  )  with  real  eigenvalues  A.. 

•If  ^  ^ 

i  =  l,2,***,n  .  Then  we  have,  A  =  (UDU  )  =  A  ,  which 

proves  that  A  is  Hermitian. 

□ 


$4^  •  jj 


('  ;  ■  -  ■  •  .(  I  ■ 


CHAPTER  9 


REAL  MATRIX 


§9:0  Prel iminaries. 

Given  real  A  ,  its  characteristic  polynomial  det(A-AI)  has 
real  coefficients.  Thus  complex  eigenvalues  of  a  real  matrix  occur  in 
conjugate  pairs  and,  if  the  order  n  of  A  is  odd  then  it  has  at  least 
one  real  eigenvalue.  Further,  if  n  is  even  and  det  A  <  0  then  A 
has  at  least  two  real  eigenvalues.  The  following  theorem  provides  a 
necessary  and  sufficient  condition  for  a  real  matrix  to  have  real  eigen- 
val ues : 

Theorem  1 :  Let  A  be  a  real  nxn  matrix,  with  eigenvalues,  A.  , 
i  =  l,2,*«*,n  .  Then  there  exists  a  real  orthogonal  matrix  U  and  a 
triangular  matrix  T  such  that  A  =  UTU'  ,  with  t..  =  A.  , 
i  =  l,2,***,n  if  and  only  if  the  eigenvalues  of  A  are  real. 

Proof:  (See  [32,  pg.  497]. 

□ 

In  this  chapter  we  shall  consider  a  general  real  matrix. 
However,  several  special  types  of  real  matrices  exist.  Nonnegative 
matrices  are  dealt  with  in  the  next  chapter.  Unless,  otherwise  stated 
we  shall  assume  that  the  eigenvalues  are  ordered  as: 


96 


/ 


,  «i<  •••»$*!  *  f  I 


. \.  .  ,  .) 


I  .  . 
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§9:4.2 

•k 

Given  tr  AA  and  the  diagonal  elements  of  a  real  matrix,  we 
have  the  following  results: 

(a)  For  | A. |  =  max  | A . |  : 

1  i  1 

Given  real  A  , 

I  A,  |  <  max  |  a .  •  |  +  (tr  AA*  -  £  a.,2)1/2  •  0) 

i  i  1 1  i  1 1 

Proof:  Since  |A, |  <  cr,  ,  the  proof  follows  from  (3)  below. 

1  1  □ 


(b)  For  | A^ |  =  min  | A^ |  : 

Given  real  A  , 

min  | a . .  |  -  (tr  AA*  -  l  a..2)1/2  <  | A  |  a  (2) 

j  i  i  ^  I  i  r  i 

Proof:  From  Theorem  11:4:1  (1),  we  have  an  <_  | An |  .  Thus 
(2)  follows  from  (4)  below. 

□ 


The  following  result  is  given  in  [7,  pg.  671: 
(g)  For  singular  values: 


Given  real  A  , 


3 


s  T •  V  ^  (dl  ill 


' 
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*  "  2J/2 


r,  <  max  a . .  +  (tr  AA  -  Y  a. .  ) 
1  —  .  n  4  it' 


and 


*  -  2x1/2 


min  | a. . I  -  (tr  AA  -  Y  a..  <  a 

1  n 1  v  n  '  -  n 


(3) 


(4) 

□ 
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§9:6 

The  following  result  involving  row  sums  of  a  real  matrix  is 
given  in  [54]: 

(c)  For  Ak  : 

Let  A  be  a  real,  irreducible  matrix  such  that  a..  >_  0  , 

1  £  i  <_  n  ,  a .  •  <_  0  for  all  i  f  j  .  Further,  assume  that  A 

*  U 

is  weakly  diagonally  dominant.  Then  X  =  0  is  an  eigenvalue 
of  A  if  and  only  if 


l  a.,  =  0  ,  i  =  .  (1) 

j  J 

Proof:  If  (1)  holds  then  clearly  X  =  0  is  an  eigenvalue  of 
A  ,  with  corresponding  eigenvector  x  =  (1,1, •••,!)'  .  Conver¬ 
sely,  let  x  be  an  eigenvector  corresponding  to  the  zero  eigen¬ 
value  of  A  and  r  be  one  of  the  indices  for  which 
|x.  | ,  i  =  1 ,  2,  . . .  n  is  maximum.  Finally,  suppose  the  pth 
relation  in  (1)  is  not  an  equality.  Then  we  have 


a„„  >  7  I  a.  I  , 
pp  j£p  pjl 


and  Ax  =  0  implies. 


"aPpXp  kip  apk  Xk  * 


and 


PP 


x  |  <  y 


pk 


<  a 


PP 


x 

r 


*  6 


i'i  3'K  (f)  rtf  no?*  <'.•>' 
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Thus  |xr|  >  |X|J  for  at  least  one  value  of  k  and 
arr  |xrl-k^r  |ark!  h'  ’ 

which  gives  a  <  l  |a  ,  |  ,  unless  a  .  =  0  for  which 
rr  rK  n 

| x  |  >  |x. |  .  If  this,  however,  is  the  case,  then  the  rth 

row  contains  n-s  zeros  where  s  is  the  number  of  suffixes 

j  for  which  | x - |  =  | x  |  All  the  s  corresponding  rows 

j  r 

contain  n-s  zeros  in  the  same  places.  But  this  implies  A 
is  reducible.  Therefore, 

hi =  hi =  ••• =  hi  * 

and  (1)  follows.  □ 
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§9:6.2 

In  this  section  we  shall  give  results  which  involve  row  sums 
and  the  diagonal  elements. 

The  following  result  is  well-known  (e.g.  see  [15,  pg.  261]): 


(c)  For  Ak  : 

Let  A  be  a  real  matrix  with  positive  diagonal  elements.  If 
A  is  weakly  diagonally  dominant,  that  is. 


a .  ,•  >  P .  =  y 

n  -  i  • 

|  a .  .  I 

1  1J1 

,  i  =  1 , 2 ,  •  •  • ,  n  , 

(1) 

then: 

Re(A.)  > 

0  , 

i  =  1 , 2 ,  •  •  • ,  n  . 

(2) 

Further,  in  case  a,. 

<  0  , 

i  =  1 ,2,***,n  ,  then: 

Re(A.)  < 

0  , 

i  =  1 ,2,***  ,n  . 

(3) 

If  the  inequalities  in  (1)  are  strict  then  so  are  those  in  (2) 
and  (3). 

Proof:  From  the  Gerschgorin ' s  Theorem  (see  6:2),  for  each 
eigenvalue  X  of  A  ,  there  exists  1  <  i  <  n  ,  such  that 


Thus  we  have, 


. 


-  •  '  ;  »  •.  ■  '-MXI'  r  ‘  •  "• 


e  n  t  b2tf>3  DrtJ  nl 
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|  Re ( A )  -  a^.  |  <  P.  , 

which  yields  (2)  if  all  the  diagonal  elements  are  positive  and 
(3)  if  they  are  all  negative. 

□ 


(f)  For  product  of  eigenvalues: 

If  the  diagonal  elements  of  A  are  positive  and  A  is  diagon¬ 
ally  dominant,  that  is, 

aii  >  I  I3,--,-!  >  i  =  1.2, •••,n  , 

11  jtM  1J 

then  det  A  >  0  and 


where 


n  (a.  .-b.)  <_  det  A  £  n  (a.  .+b. )  , 

i  11  1  i  11  1 

l  I  a  -  - 1  (1  <  i  <  n) 

i+1  1J 

bi  -  < 

,0  (i  =  n) 


(4) 


Proof:  Since  A  is  diagonally  dominant,  we  conclude  that 
strict  inequality  holds  in  (2).  Thus  all  the  real  eigenvalues 
are  positive.  Now,  as  the  complex  eigenvalues  of  A  occur  in 
conjugate  pairs,  we  conclude  that  det  A  >  0  .  The  proof  of 
(4)  is  given  in  [39,  pg.  33]. 


□ 


•  ‘  • 
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CHAPTER  10 


NONNEGATIVE  MATRIX 


§10:0  Prel iminaries. 

Given  a  real  matrix  A  =  (a.  -)  with  a.  -  >_  0  ,  i , j  =  l,2,***,n 

*  J  1  J 

then  A  is  called  nonnegative.  In  case  a^.  >  0  for  all 
i , j  =  l,2,*«*,n  ,  then  A  is  said  to  be  positive.  We  shall  write  A>_0  , 
if  A  is  nonnegative  and  A  >  0  if  A  is  positive. 

As  we  shall  see,  nonnegative  matrices  have  some  very  interesting 

spectral  properties.  Such  matrices  arise  in  various  applied  fields  of 

study.  Further,  given  a  matrix  A  ,  if  we  define  |A|  =  (|a..|)  then 

p ( A)  <_  p ( | A | )  ,  where  p(A)  is  the  spectral  radius  of  A  ,  that  is, 

p( A)  =  max  | X . |  .  Thus,  an  upper  bound  for  p(|A|)  provides  an  upper 
i 

bound  for  p(A)  .  In  fact  if  A  is  nonnegative  and  B  =  (b.  .)  is  such 

•  J 

that  |  b .  - 1  <_a..  ,  i ,  j  =  l,2,*«*,n  ,  then  p(B)  <_  p(  |  B  | )  <_  p(A)  . 

In  this  section  we  shall  first  classify  the  nonnegative  matrices 
and  then  state  some  important  theorems  regarding  them. 

Definition  1.  Given  a  nonnegative  matrix  A  ,  it  is  called  primitive  if 
there  exists  a  positive  integer  k  such  that  A^  >  0  . 

□ 

Clearly  a  positive  matrix  is  primitive.  We  shall  denote  the 
(i,j)th  element  of  Am  by  a..^  ,  where  m  is  a  positive  integer. 

'  vJ 

The  following  result  provides  another  definition  for  an  irreducible  matrix. 
It  is  proved  in  [31,  pg.  122]. 
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Lemma  2.  Given  a  nonnegative  matrix  A  ,  it  is  irreducible  if  and  only 
if  for  each  i,j  (1  <_  i  ,  j  <_  n)  there  exists  a  positive  integer 
m  =  m(i,j)  such  that  a..^  >0  . 

□ 

Given  any  matrix  A  ,  if  a.,  f  0  ,  i  f  j  ,  i ,  j  =  l,2,-«*,n 

•  J 

then  A  is  irreducible.  A  matrix  with  a  row  or  column  of  zeros  is  reduc¬ 
ible.  In  fact  a  reducible  matrix  must  have  at  least  n-1  zeros  (see  [15, 
pg.  264]).  Furthermore,  a  primitive  matrix  (in  particular  a  positive 
matrix)  is  always  irreducible,  but  the  converse  is  not  true.  For  example. 


is  irreducible  but  is  not  primitive  (see  [31,  pg.  123]).  However,  we 
have  the  following  result. 

Theorem  3.  If  A  is  nonnegative,  irreducible  and  a..  >  0  for  some  i  , 
i  ,  1  <  i  <  n  then  A  is  primitive. 


Proof:  See  [21]. 


□ 


We  shall  further  classify  nonnegative,  irreducible  matrices. 
To  accomplish  this  we  shall  need  the  following  definitions: 

Definition  4:  Given  indices  i , j  ,  1  <  i  ,  j  <  n , ,  we  say  i  1 eads  to 


j  ,  and  write  i  j  ,  if  there  exists  a  positive  integer  m  ,  such  that 


.tU&.’i  ,1  ’>tr  ■  ■  .rf?  evsn 
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a 


ij 


(m) 


>  0  . 


□ 


Definition  5.  If  i  ->  j  and  j  -*  i  then  we  say  i  and  j  communi¬ 
cate,  and  wri  te  i  +•*■  j  . 

□ 


Definition  6. 


the  index  i 
(k) 


aii 


>  0  . 


If  i  ++  i  ,  1  £  i  £  n  ,  then  d(i )  ,  cal  led  the  period  of 
is  the  greatest  common  divisor  of  those  k  for  which 


□ 


Remark  7.  Given  an  index 
d(i)  =  1  . 


such  that  a^  >0  ,  1  £  i  £  n  ,  then 

□ 


Lemma  8.  Given  A  nonnegative,  if  i  and  j  are  such  that  i«-*j 
then  d(i )  =  d( j) . 

Proof:  See  [51 ,  pg.  14] . 

□ 

Lemma  9.  Given  a  nonnegative,  irreducible  matrix  A  ,  all  indices  have 
the  same  period. 


Proof:  From  Lemma  (2)  for  a  nonnegative,  irreducible  matrix,  given 
indices  i  and  j  ,  i«-»-j  .  Now  the  result  follows  from  Lemma  (8). 

□ 


Now,  in  the  definition  below  we  classify  nonnegative,  irreduc¬ 
ible  matrices: 

Definition  10.  A  nonnegative,  irreducible  matrix  A  is  called  cycl ic 
with  period  d  if  the  period  of  any  one  of  its  indices  satisfies  d  >  1 
and  is  called  acycl i c  if  d  =  1  .  n 


. 


' 


. 
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Below,  we  give  the  precise  relationship  between  a  nonnegative, 
irreducible  matrix  and  a  primitive  matrix. 

Theorem  1 1 .  A  nonnegative,  irreducible,  acyclic  matrix  is  primitive  and 
conversely. 

Proof:  See  [51,  pg.  18]. 

□ 


In  view  of  the  above  discussion,  in  this  chapter  we  shall  give 
results  for  nonnegative,  nonnegative  irreducible,  cyclic  and  acyclic  or 
primitive  matrices.  We  also  note  that  if  A  is  reducible,  i.e. 


where  D  and  E  are  pxp  and  qxq  complex  matrices,  then  the  n 
eigenvalues  of  A  are  the  p  eigenvalues  of  D  and  q  eigenvalues  of 
E  (see  [31,  pg.  23]).  Thus  if  A  is  reducible  the  problem  of  locating 
the  eigenvalues  of  A  can  be  solved  by  considering  irreducible  matrices 
of  smaller  order. 


As  we  shall  see,  the  largest  eigenvalue  in  modulus  of  a  non¬ 
negative  matrix  is  always  nonnegative.  Usually,  this  eigenvalue  is 
denoted  by  r  and  is  often  called  the  Perron  root  of  A  .  Throughout 
this  chapter  we  shall  assume  that  the  eigenvalues  of  A  are  ordered  as: 


' 


. 
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The  following  four  theorems  are  given  in  Chapter  1  of  [51]. 

Theorem  12.  If  A  is  nonnegative,  then  there  exists  an  eigenvalue  r  , 
such  that: 

(i)  r  is  real  and  nonnegative; 

(ii)  r  can  be  associated  with  nonnegative  left  and  right  eigen¬ 
vectors; 

(iii)  r  =  x1  >  |X. |  ,  i  =  2,3,* •• ,n  ; 

(iv)  if  0  £  B  £  A  (i.e.  0  <_  b.  •  <  a.  .  ,  1  <  i  ,  j  <  n)  and  3 

'  '  \J 

is  an  eigenvalue  of  B  ,  then  |g|  <_  r  . 

□ 

Below,  we  give  the  Perron  -  Frobeni us  Theorem  for  primitive 

matri ces : 

Theorem  13.  If  A  is  primitive  then,  there  exists  an  eigenvalue  r 
such  that: 

(i)  r  is  real  and  positive; 

(ii)  r  can  be  associated  with  positive  left  and  right  eigenvectors; 

(iii )  r  =  X-j  >  \X.  |  ,  i  =  2,3,* ••  ,n  ; 

(iv)  r  is  a  simple  eigenvalue  of  A  ; 

(v)  the  eigenvectors  associated  with  r  are  unique  to  constant 
multiples; 

(vi)  If  0  <_  B  <_  A  and  3  is  an  eigenvalue  of  B  then  1 3|  £  r  . 
Moreover,  3  =  r  implies  B  =  A  . 

□ 


’ 


/ 


■ 


‘ 
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Next,  we  state  the  Perron  -  Frobeni us  Theorem  for  a  nonnegative, 
irreducible  matrix: 

Theorem  14.  If  A  >_  0  is  irreducible,  then  all  the  results  of  the  prev¬ 
ious  theorem  hold  except  that  (iii)  is  replaced  by  a  weaker  result: 
r  =  -  l^-jl  >  i  =  2,3,* ••  ,n  .  Further,  if  A  X-j  =  \X^\  =  •••  =  |xj 

then  they  are  the  i  distinct  roots,  X-je1^77^,  k  =  0,1, •••,£-!  ,  of 

o  5. 

X' -  r6  =  0  . 

□ 

Theorem  15.  If  A  is  cyclic  with  period  d  >  1  ,  then  there  exist 
exactly  d  distinct  eigenvalues  with  |X|  =  X-j  .  In  fact  these  eigen¬ 
values  are  X-| e1  ^^k/d  ^  k  _  g,l,...,d-l  . 


Below,  we  summarize  the  eigenvalue  inequalities  most  of  which 
follow  from  the  above  theorems. 

(c)  For  X.  : 


(i)  Given  A  nonnegative  (primitive)  then  is  nonnegative 


(positive)  and 


Xkl  £  (<)  ^  X-j 


Further,  X-j  is  simple  for  A  nonnegative,  irreducible, 


□ 


(ii)  If  A  is  cyclic  with  period  d  >  1  then  there  are  exactly  d 
distinct  eigenvalues  with  modulus  X-j  ,  in  fact 


Ak+1  =  A1  el2,rk/d  ,  k  =  0,1  ,•  •  •  ,d-l  . 


□ 


ajiri  r :  ■.  ...  sc- •' 'r  ,-r  o'. 
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(e)  For  sum  of  eigenvalues: 

(i)  Given  a  nonnegative  matrix  A  , 

0  <  tr  A^  ,  k  >  1 


Proof:  Trivial. 


□ 


( i i )  If  A  is  cycl i c  then , 

tr  A  =  T  A.  =  0  . 

i  1 

Proof:  The  proof  is  immediate  from  Theorem  (3). 


□ 


' 


f 

. 


I  • 
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§10:1 

In  this  section  we  shall  give  results  which  involve  only  tr  A 

and  n  . 

(a)  For  r  =  A,  =  max  | X. \ 

1  i  1 

(i)  Given  A  nonnegative  (primitive), 

tr  A/  n  <  (<)  r  .  (1) 

Proof:  Inequality  (1)  is  immediate  from  Theorems  0  (12)  and 
0  (13). 

(ii)  If  A  >_  0  is  irreducible  and  tr  A  >  0 

tr  A 

— rT  r  * 

Proof:  From  Theorem  0  (3)  we  have  that  A  is  primitive.  Now 
(2)  follows  from  the  previous  result. 

□ 

(c)  For  Ak  : 

If  A  is  cyclic  with  period  d  >  1  then: 

tr  A/n  £  |X.|  ,  i  =  l,2,»«*,d  .  (3) 

Proof:  Inequality  (3)  is  immediate  from  (1)  and  Theorem  0 


then : 

(2) 


(15). 


□ 


f 
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(e)  For  sum  of  eigenvalues: 

The  following  result  is  given  in  [6,  pg.  88]. 

Given  A  nonnegative  and  tr  A  , 

z .  nNm  ^  m-1  r  ^  m  m-1  .  nm 

(tr  A)  £  n  i  X.  =  n  tr  A 

i 


Proof:  From  Holder's  inequality  we  have, 


/ v  \m  ^  m-1  r  „  m  ^  , 

(I  a..)  in  I  a. .  ,  m  >  1 


v  i  i 


Now,  (4)  follows  from  2  (2)  below. 


(4) 


□ 


(g)  For  singular  values: 

Given  A  £  0  ,  for  any  positive  integer  m  , 

(tr  A)m  <  n"1'1  l  a.m  .  (5) 

i  1 

Further,  if  A  is  cyclic  with  period  d  >  1  then 

d 

d  tr  A/n  <  J  a.  .  (6) 

i=l  1 

Proof:  Using  Theorem  11:4:1  (1),  inequalities  (5)  and  (6) 
follow  from  (4)  and  (3)  respectively. 

□ 


. 

I  •  >  •;  U 
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10:2 

Here  we  shall  give  bounds  which  involve  the  diagonal  elements 

of  A  . 

(a)  For  r  =  =  max  | A,. |  : 

The  following  result,  due  to  Frobenius  is  well-known: 


If  A  >_  0  iis  irreducible,  then: 

max  a..  £  r  . 
•  11 


(1) 


Proof:  From  Theorem  0  (14),  there  exists  a  positive  vector  x 
such  that  Ax  =  A-jX  .  Thus,  we  have 


A,x.  =  y  a.,x,  >  a.  .x.  , 

1  i  £  lk  k  -  n  i 

Now  (1)  follows  as  x^  >  0  for 


i  =  1 ,2, • • • ,n  . 

i  =  1 , 2 ,  •  •  • ,  n  . 


□ 


(e) 


For  sum  of  eigenvalues: 

The  following  result  is  given  in  [6,  pg.  88]. 

Given  A  nonnegative,  then  for  any  positive  integer  k  , 


Proof:  Trivial. 


□ 


< 
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§10:3 

2 

In  this  section  we  shall  give  bounds  which  involve  tr  A  . 
Most  of  the  results  are  immediate  from  the  theorems  of  Section  0. 


(a)  For  r  =  A,  =  max  | A. |  : 

1  i  1 

If  A  is  nonnegative  (primitive)  then: 

(tr  A^/n)^^  <  (<)  r  .  (1) 

□ 


(c)  For  Ak  : 


If  A  is  cyclic  with  period  d  >  1  then: 


/tr  A  J/2  „  i ,  i  „•  _  n  o  ^ 

( — - — )  £  \X.  |  ,  l  =  1 ,2,***  ,d  . 


(2) 

□ 


(e)  For  sum  of  eigenvalues: 

The  following  result  is  given  in  [6,  pg.  88]: 

Given  A  nonnegative  and  a  positive  integer  m  >_  1  ,  then 


(tr  A2)m  <  nm_1  tr  A2m 


(3) 


(tr  A) ^  <  n  tr  A^ 


(4) 


Proof:  The  diagonal  elements  of  A^  are  ^  ai(<  aj<i  5 
i  =  l,2,*»*,n  .  Thus,  from  the  Holder's  inequality. 


,2x171  m-1 


(tr  A  )  £  n  l  (I  a.kaki) 


m 


l  k 


9 


-  fr*  »  <}  1 


. 


,  ",SA  it  «  »  fSA  rf)  • 


1:10:3 


114 


and  from  2  (2) , 

(tr  A2)m  <  n"1’1  tr  A2m 


which  proves  (3).  Inequality  (4)  follows  from  1  (4). 

□ 


(g)  For  singular  values: 

If  A  is  nonnegative  (primitive)  then: 

tr  A2  /  n  £  (<)  a-|2  . 

Further,  in  case  A  is  cyclic  with  period  d  >  1  then: 

2  d 

d  tr  A  /  n  <  l  a . 

i=l  1 


(5) 


(6) 

□ 
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§10:5.4.3 

In  this  section  we  shall  give  bounds  for  the  imaginary  parts 
of  the  eigenvalues  of  A  .  Their  proofs  are  given  in  [64].  They  involve 
the  use  of  the  facts  that  A-j  is  real  and  that  the  complex  eigenvalues 
of  A  occur  in  conjugate  pairs.  We  shall  omit  these  proofs. 


As  in  Chapter  5,  let 


(MCI,4-!  |  I  D|  |2)1/2 


if  l!CM  >  I  I B |  | 


(1) 


otherwise. 


I  I A  |  | 


and 


Kc£  =  I  |C|  I2  -  (^)1/2  I  ID|  | 


(2) 


where,  B  =  ^  (A+A  )  ,  C  =  (A— A  )  and  D  =  AA  -A  A  . 


Finally,  let  the  eigenvalues  of  A  be  ordered  as: 


Im(A.|)  £  Im^)  £  •••  £  ImUn) 


(c)  For  Ak  : 


u 

For  n  £  3  and  and  as  above. 


(max(0  ,  — U-  K  j^)}"1^2 
2p  c 


£  ImU-,)  <  [\  KCU)1/2 


where  p  =  [^-]  .  A1  so  for  k  £  [^-]  , 

Im(Ak)  £  Kc  ) 
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Proof:  See  [64] . 


□ 


(e)  For  sum  of  eigenvalues: 


Given  1  <  j  <  k  <  [—1]  =  p  and  K  u  ,  as  in  (1)  and 


Z 


-  J  -  -  L  2 


(2), 


C  5  C 


k-j+l  l  Im^Ai'  -  (2k 


{max  (0  ,-U  kr4)}1/2  <  1  l  Im(A.) 

2p  ^  K  1  1 


and 


|  -  Im(Xk)  |  <_ 


r  P  KrU  -  Kr  ^1/2  ,! 


VC  lXC 

2p 


(—  +  — ] _ )^Z 

p-k+1 


Proof:  See  [64] . 


□ 


' 
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§10:6 

In  this  section  we  shall  give  results  which  involve  only  the 
row  or  column  sums.  We  recall  that, 


The  following  is  a  well-known  result  due  to  Frobenius: 


(a)  For  r  =  X,  =  max  | X .  |  : 

1  i  1 

(i )  Given  A  £  0  , 

min  R.  £  r  £  max  R.  (2) 

i  1  i  1 

Further,  if  A  is  irreducible  then  equality  on  either  side 
implies  equality  throughout.  • 

Proof:  If  we  prove  (2)  for  a  positive  matrix  then  by  continu¬ 
ity  it  will  also  hold  for  A  nonnegative.  So  we  assume 
A  >  0  .  If  x  is  a  positive  eigenvector  corresponding  to  r 
then.  Ax  =  rx  .  Thus, 

l  aikxk  =  r  x.  ,  i  =  1 , 2 ,  •  •  • ,  n  , 
k 

which  gives. 


Now  since 


r  max  x.  <  )  a.,  max  x. 
i  1  -t  ik  i  1 


r  min  x.  >  T  a.,  min  x. 
i  1  k  ik  i  1 


min  x.  >0  ,  (2)  follows, 
i  1 


5 


Further,  for  irreducible 


:!  *.n  i  ’60S^I  SW  .  .*:•  :-‘C  rjfoj 
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A  ,  let  equality  hold  on  one  side  of  (2)  only.  Then  we  can 
increase  or  decrease  the  elements  of  A  (keeping  A  irreduci¬ 
ble)  so  that  all  row  sums  become  equal  and  r  is  unchanged. 

But  from  Theorem  0  (14)  if  B  is  such  that  0  £  B  £  A  then, 
p(B)  £  p(A)  and  equality  holds  only  if  B  =  A  .  Thus  we  have 
a  contradiction,  which  completes  the  proof. 

□ 


(ii )  Given  A  £  0  , 

min 
i 

where  x  is  any  positive  vector.  In  case  A  is  irreducible, 
equality  on  either  side  of  (3)  implies  equality  on  both  sides. 

Proof:  For  given  x  =  (x.)  >  0  ,  let  X  =  diag(x^ jX^,* •• ,xn)  . 
Then  the  result  follows  when  (2)  is  applied  to  X”"' AX  . 

□ 


I  a..x. 


x. 

l 


£  r  £  max 
i 


y  a.  .x . 
j  U  J 

xi 


(3) 


(c)  For  Ak  : 

If  A  is  cyclic  with  period  d  then: 

min  R.  £  |X. |  £  max  R.  ,  i  =  l,2,«**,d  .  (4) 

i  1  1  1  1 

Proof:  The  proof  is  immediate  from  Theorem  0  (15)  and  (2). 

□ 


- 


'*o:fjsv  svtttgoq  v»*  er  x  ai-irtw 


n«rtK.'  .1 
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(g)  For  singular  values: 

Given  A  >  0  , 


min  R.  £ 


(5) 


Proof:  Since  £  a-j  ,  (5)  follows  from  (2). 


□ 


f 
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§10:6.2 

Here,  we  shall  give  bounds  which  involve  only  row  sums  and  the 
diagonal  elements  of  A  . 


(a)  For  r  =  X-j  =  max  | A. |  : 


If  A  >  0  is  irreducible  then: 


min  M(i ,j)  £  r  £  max  M(i ,j)  , 


where. 


M(i,j)  =l{a1.+a.j  +  [(ai1-a.j)2  +  4  P^.]172}  . 


and 


i  ■  X  au  •  i>j  =  • 


j/i 


Proof:  See  [8] . 


(g)  For  singular  values: 


If  A  >  0  is  irreducible  then 


min  M(i  ,j)  £  a,  , 

W 


where  M(i,j)  is  given  by  (2). 


Proof:  Since  X-j  £  ,  (3)  follows  from  (1) 


(1) 


(2) 


□ 


(3) 


□ 


— 


■ 


,'S)  y  r 


. 
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Here  we  shall  give  results  which  involve  only  det  A 
proofs  are  immediate  from  the  theorems  of  Section  0. 


(a)  For  r  =  X,  =  max  | A . |  : 

1  i  1 

If  A  is  nonnegative  (primitive)  then 

| det  A| £  (<)  r 


(c)  For  Ak  : 


If  A  is  cyclic  with  period  d  >  1  then: 


I  det  A|1/n  <  |Xk|  ,  k  =  1,2, --.d 


(g)  For  singular  values 


Given  A  nonnegative  (primitive), 

| det  A|  "I^n  £  (<)  a-j 


Further,  if  A  is  cyclic  with  period  d  >  1  then 

i  /  d 

d  |  det  A  |  'n  £  l  a. 

i=l  1 


.  Their 


(1) 

□ 


(2) 

□ 


'  'r!  .  4«b| 
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Given  the  row  sums  and  the  det  A  ,  we  have  the  following  lower 
bound  for  the  condition  number: 

(h)  For  the  condition  number: 

Given  A  ,  if  det  A  f  0  then: 

0  £  min  R.  /  |  det  A|  <_  c(A)  , 

i  1  ”  lAnl 

where  R.  =  Y  a. .  . 

1  i  1J 

Proof:  The  above  inequality  is  immediate  from  6  (2)  and  the 
fact  that  | X  |  <_  | det  Al^11  .  Note  that  det  A  f  0  implies, 

min  R.  >  0  . 

i  1  □ 


if 
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123 


§10:8 

Given  A  >  0  and  that  the  eigenvalues  A.  ,  i  =  l,2,««*,n 

of  A  are  real,  let  a-j  >  X^  ^  ^  An  .  Since  A  is  nonnegative 

tr  A  =  ^  A.  >0  .  When  the  eigenvalues  of  A  are  such  that 
A-j  >  0  >  ^2  -  *  *  *  -  xn»  then  these  two  facts  guarantee  that  there 
exists  a  symmetric  matrix  S  ,  with  X.  ,  i  =  l,2,**«,n  as  its  eigen¬ 
values  (see  [6,  pg.  90]).  However,  with  this  information  one  cannot 

conclude  that  A  is  symmetric.  For  example. 


is  nonnegative,  with  A-j  =  3  and  A^  =  1  .  But  A  is  not  symmetric. 


□ 


1 


CHAPTER  11 


NORMAL  MATRIX 


§11:0  Preliminaries, 

★ *  * 

The  matrix  A  is  called  normal  if  AA  =  A  A.  Thus,  Hermitian, 
Unitary  and  Skew  -  Hermitian  matrices  are  examples  of  normal  matrices. 
Normal  matrices  have  some  special  properties.  In  general  a  matrix  is 
diagonalizable  if  all  its  eigenvalues  are  distinct.  However,  a  normal 
matrix  is  always  unitarily  diagonalizable.  Below  we  give  some  properties 
of  a  normal  matrix. 


First  we  give  some  conditions  which  are  equivalent  to  a  matrix 


being  normal.  Their  proofs  and  several  other  equivalent  conditions  can 
be  found  in  [16]. 

Theorem  1 .  Given  A  ,  each  of  the  following  conditions  is  equivalent  to 

A  being  normal: 


*  * 

(i)  AA  -  A  A  is  positive  semidefi ni te. 


* 


(ii)  A  can  be  represented  as  a  polynomial  in  A  . 

(iii)  A  can  be  reduced  to  a  diagonal  form  by  a  unitary  similarity 
transformation. 


(iv) 


(v)  The  singular  values  of  A  are 


A  ,  I  ,  |  A, 


2  i  ’ 


•  •  •  ,  A 


n 


124 
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1 *  *  1  * 

(vi)  The  eigenvalues  of  (A+A  )  and  (A-A  )  are  precisely 
Re(X. )  and  Im(X. )  ,  i  =  l,2,«*»,n  ,  respectively. 

□ 

The  following  results  are  well-known  (e.g.  see  [31,  pg.  64]). 

Theorem  2.  Given  normal  A  ,  it  is  Hermitian  if  and  only  if  its  eigen¬ 
values  are  real . 

* 

Proof:  Let  the  eigenvalues  of  A  be  real.  Then  A  =  UDU  ,  for  some 

unitary  matrix  U  and  real  matrix  D  =  di ag(A^  ,Xg ,•  •  •  •  ,X  )  and 
★  ★  * 

A  =  (UDU  )  =  A  .  Thus  A  is  Hermitian.  The  converse,  is  trivial. 

□ 

Considering  the  matrix  iA  the  above  Theorem  yields  the  fol¬ 
lowing: 

Theorem  3.  Given  normal  A  ,  it  is  skew  -  Hermitian  if  and  only  if  the 
eigenvalues  of  A  are  purely  imaginary. 

□ 

Theorem  4.  Given  normal  A  ,  it  is  unitary  if  and  only  if  the  eigen¬ 

values  of  A  have  absolute  value  one. 

Proof:  Given  |x^|  =  1  ,  i  =  l,2,--»,n  ,  Theorem  (1)  implies  =  1  , 

i  =  l,2,««-,n  .  Thus  from  the  Singular  value  decomposition  theorem 

(see  Theorem  11:4:0  (4)),  we  get  A  =  UV  for  some  unitary  matrices  U 

and  V  .  Now,  as  the  product  of  two  unitary  matrices  is  a  unitary 

matrix,  we  conclude  that  A  is  unitary.  Conversely,  A  unitary  implies 

★ 

AA  =  I  and  again  we  have  =  1,  i  =  l,2,«*«,n  .  Finally,  from 

Theorem  (1),  a ■  =  I X . I  =  1  ,  which  completes  the  proof. 

1  1  □ 


/  -  li 


•l-r  .  :  '\  '  ■  fV 

,  f  •  jt>  asrftjmt  ft)  n'y#T  .  —  *  )  .4  *  fitj  mvK>  :'TOtrr<l 


- 
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The  following  results  are  given  in  [45]  and  [46] : 

Theorem  5.  The  diagonal  elements  of  a  normal  matrix  A  are  its  eigen¬ 
values  if  and  only  if  A  is  a  diagonal  matrix. 

Proof:  Let  a^ .  ,  i  =  1 ,2 ,• • • ,n  be  the  eigenvalues  of  A  then,  from 
Theorem  (1),  |a--|  ,  i  =  l,2,---,n  are  the  singular  values  of  A  . 

★  O  O 

Thus ,  tr  AA  =  J  I  a .  .  I  =  Y  I  a . .  I  ,  gi ves  a . .  =  0  ,  i  f  j  .  Conver- 

•  “  •  i  j  4  1  n  1 *  *  3  i  j 

I  5  J  I 

sely  if  A  is  diagonal  then  clearly  a^  ,  i  =  l,2,*»*,n  are  its  eigen¬ 
values.  n 


Theorem  6.  Given  normal  A  , 

I  I  =  I  ^2 1  =  *  *  ’  =  I  H  ) 

if  and  only  if  A  =  cU  ,  for  some  scalar  c  and  unitary  U  . 


Proof:  Proof  follows  at  once  from  the  Singular  value  decomposition 
theorem  (see  Theorem  11:4:0  (4)). 

□ 


Theorem  7.  Given  normal  A  then: 


h  =  x2  =  =  xn  ’ 

if  and  only  if  A  is  a  scalar  matrix. 


(2) 


•k 

Proof:  From  Theorem  (1),  there  exists  a  unitary  U  such  that  A  =  UDU  , 

★ 

where  D  =  diagUi  .Xg**  ••  ,An)  .  Thus  from  (2)  A  =  X-|  UU  =  A-|  I  .  The 


converse  is  clear. 


□ 


' 


■ 
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Remark  8.  From  Theorem  (1),  we  have  that  for  a  normal  matrix 

=  |x..|  ,  i  =  l,2,«»*,n  .  Thus,  bounds  for  |X^|  's  are  also  valid 
for  a.  's  .  In  view  of  this  we  shall  not  give  bounds  for  singular  values 
explicitly.  We  also  notice  that  Re(X. )  and  Im(A-j)  ,  i  =  l,2,«**,n 
are  the  eigenvalues  of  Hermitian  matrices,  B  =  j  (A+A  )  and 
C  =  (A-A  )  ,  respectively.  Thus,  bounds  for  real  and  imaginary  parts 
of  the  eigenvalues  A  can  be  derived  by  considering  B  and  C  . 


□ 


1:11:2 
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In  this  section  we  shall  give  results  which  involve  only  the 
diagonal  elements  of  A  . 

(a)  For  |  A1 1  =  max  | |  : 

Given  A  , 


max  |  a  .  •  |  <  |  A-,  |  .  (1 ) 

i  11-1 

Equality  holds  if  and  only  if  A  is  diagonal. 

Proof:  Since  for  normal  A  ,  a-j  =  |  A-j  |  ,  inequality  (1)  is 
immediate  from  Theorem  11:4:4  (7).  The  condition  for  equality 
is  clear  from  Theorem  (5). 

□ 


(c)  For  Ak  : 

Given  A  , 


max 

i 

Re(a. . )  <  max  Re(A. )  ; 

n  -  .j  i 

(2) 

max 

i 

Im(a^  )  <  max  Im(A^ )  ; 

(3) 

mi  n 
i 

Re(A^. )  <  min  Re(a. . )  ; 

i 

(4) 

and 

min 

Im(A.j )  <  mi  n  Im(a^- )  ; 

(5) 

Proof:  As  mentioned  in  the  Remark  (8),  for  normal  A,Re(A^) 
and  Tm(A. )  ,  i  =  l,2,*«-,n  are  the  eigenvalues  of  Hermitian 


- 


\ 


l  9  ?  (. .*)<?£  nffli 
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1  *  l  * 

matrices  B  =  (A+A  )  and  C  =  (A-A  )  respectively. 

All  of  the  above  inequalities  follow  from  the  fact  that  if  P 
is  Hermitian  then  X n  £  min  £  max  p..  £  X-j  (see  12:2  (1) 
and  12:2  (2))  . 


(d)  For  the  spread: 

Given  A  , 


3^  max  |  a  -  - 1  <  3 max  |a..|  <  sp(A)  .  (6) 

i  i,j  1J  ~ 

Proof:  See  [40]. 

□ 

(e)  For  sum  of  eigenvalues: 

If  the  diagonal  elements  of-  A  ordered  as  |a^|  _>  | a^£ I 


then: 

k 

k 

l  1  a  -  - 1 

i-i  11 

1  I  1^1  . 

i  =1  1 

k  =  1  ,2,«»* ,n  ; 

(7) 

n-l 

n-l 

I  laii 
i=1  11 

1  -  a  |  <  y 

nn  -  iJ1 

lx. 1  -  |X  1  . 

1  i 1  1  n1 

(8) 

Equality  holds  in  (7)  and  (8)  if  and  only  if  A  is  a  diagonal 
matrix. 


Proof:  Since  A  is  normal  we  have  =  |X..|  ,  i  =  l,2,*°*,n. 
Now,  (7)  and  (8)  follow  from  2:0  (3)  and  2:0  (4),  respectively. 
The  condition  for  equality  is  clear  from  Theorem  (5). 


□ 


r-i 


, 


•-•fi  sw  f  !;■  ion  ar  A  9ani2 
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★ 

Given  tr  AA  for  normal  A  ,  we  have  the  following  result: 

(e)  For  sum  of  eigenvalues: 

* 

Given  tr  AA  , 

£  |Ai |2  =  tr  AA*  .  (1) 

Proof:  Since  for  A  normal,  =  |  |  ,  i  =  l,2,***,n  , 

(1)  follows. 

□ 


AA  -iJ  "ovr.-1 


1:11 :4. 3 
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2  * 

Given  tr  A  ,  tr  AA  and  that  A  is  normal,  we  have  the 
following  results  for  the  sum  of  eigenvalues  of  A  : 


(e)  For  sum  of  eigenvalues: 

Given  normal  A  , 

(1) 

(2) 

(3) 

Proof:  Since  A  is  normal,  we  have  a.  =  |X^|  and  that 
Re(X. )  and  ImU^. )  are  the  eigenvalues  of  B  and  C  , 
i  =  1,2,  »«?n  .  Now  the  proof  is  clear. 


Itr  A2 |  £  l  | X. | 2  =  tr  AA*  ; 

£  (Re(X^))^  =  tr  =  Jr  (tr  AA  +Re(tr  A^))  ; 

l  ( ImU-j )  )2  =  tr  j  (Re(tr  A^)  -  tr  AA  ) 


□ 


.  s 

f 


c  ?  •  "  ~'{  jrtJ  ene  ( *A)»1  hi  5 


' 
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2  * 

Given  normal  A  ,  tr  A  ,  tr  A  and  tr  AA  ,  we  have 
tr  B  =  Re(tr  A)  /  n  ,  tr  C  =  Im(tr  A)  /  n  and  tr  B2  and  tr  C2  as  given 
by  4.3  (2)  and  4.3  (3).  Using  this  information  several  inequalities,  for 
real  and  imaginary  parts  of  the  eigenvalues  of  A  have  been  derived  in 
[63].  All  of  the  results  to  follow  are  proved  in  [63]. 

First,  we  define: 


mD  =  Re(tr  A)  /  n  =  tr  B  /  n  ,  mr  =  Im(tr  A)  /  n  =  tr  C  ,  (1 ) 

D  0 

s^  =  tr  B^  /  n  -  m^  and  s^  =  tr  /  n  -  m^  ,  (2) 

and  let  the  real  and  imaginary  parts  of  the  eigenvalues  of  A  ,  arranged 

r  n\  f  p\ 

in  decreasing  order  be  denoted  by  A.  '  '  and  A.  ,  respectively. 

(  B)  (  C) 

That  is,  A.j  =  A.  +  i  for  some  j  and  k  ,  not  necessarily 

equal . 


(c)  For  Ak  : 


With  mT  and  s^  as  above,  T  =  B,C  , 
T  i 


and 


mT  +  sT/(n-l)1/2  <  a/T) 


1  mj  "  sj/  (n_1^/2 


(3) 


(4) 


Equality  holds  in  (3)  if  and  only  if  the  (n-1)  largest  A.^'s 

J 

are  equal.  Further,  equality  holds  in  (4)  if  and  only  if  the 


(n-1)  smallest  A. 

J 


(T)  , 


s  are  equal . 


bnc  ^n\  (A  *  0  «  it\  (A  *  A-~rS 


'v 

. 


♦  0,1;  *  1  ,  :•  octe  ?.z  Ta  bfi*  j*  r't  \ 

.  >  ^(NhT,v::  si- 
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Proof:  See  [63]. 


(e)  For  sum  of  eigenvalues: 


(i)  With  and  Sj  (T  =  B,C)  as  before,  we  have: 


□ 


l 


mT  + 


(n-1 ) 


T7? 


if  a  <  n/2 


sT(n-&) 

v  mT  +  — - 1 — Try  if  l  >  n/2 


T  *(n-l)'^ 


(5) 


Equality  holds  if  and  only  if 


,  (T)  -  ,  (T) 
A1  A2 


ZZ  000 


=  X 


n-1 


(T) 


X 


(T)  _ 


1 


or  X^  =  ^ 

,  (T)  _  .  (T) 

A2  A3 


X  <T>  =  ...  =  X 

2  n-1 


=  X 


(T) 


n 


=  X. 


(T) 


when  i  <  n/2  , 

(T) 

when  l  =  n/2  , 
when  l  >  n/2 


Also , 


1 


_  ?  x  (T)< 

n-k+l  4k  j 


sT(k-l) 


m  - 

T 


mT  ” 


(n-k+l ) (n-1 ) 

S-r 


T 71  if  k  <  'j-  +  1 


(n-1) 


TJ1 


if  k  >_  j  +  1 


(6) 


Equality  holds  if  and  only  if 


,  (T)  _  ,  (T)  _ 
A1  A2 


=  X 


n-1 


(T) 


when  k  <  -X  +  1  , 


X  (T)  -  X  (T)  -  ...  -  X  (T)  or 
A1  a2  "  “  An-1  or 


••  .  W-l  .  (Tlji 


. 


. 


to 
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(T)  _  ,  (t)  _ 


X2  “  X3 


_  9  9  9 


(T) 


n 


=  X  '  when  k  =  +  1  , 


y  (T)  _  ,  (T)  _ 
a2  "  a3 


=  X. 


(T) 


n 


when  k  >  -S-  +  1 


Proof:  See  [63]. 


□ 


(iii)  With  sT  ,  T  =  B,C  as  in  (2), 


(7) 


In  case  n  is  even,  say  n  =  2q  ,  equality  holds  if  and  only 
if 

A ,(T).X ,(T)  =  ...  =  A  (TJ  and  A  +  ,(T)  =  A  <T)-...-X  (T'  .  (8) 

23  q  q+1  q+2  n  v 

Furthermore,  if  n  is  odd,  say  n  =  2q  +  1  ,  then: 


2  s T  n/(n2-l)1/2  <  x/T>  -  Xp 


(T) 


(9) 


Equality  holds  if  and  only  if  (8)  holds. 


Proof:  See  [63]. 


□ 


. 
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In  this  section  we  shall  give  results  which  involve  only  the 
row  sums.  We  recall  that. 


Ri  -I 

J 


a.  • 
U 


C .  =  l  |  a  . . 
1  j  J1 


(1) 


R  =  max  R. 


and  C  =  max  C. 
1  i  1 


(2) 


(a)  For  |  X-|  |  =  max  |  |  : 


Given  A  , 


t  s 


R  "I  o  o 

max(T 77  9  max  - TT7Z  IX  £  a.  •  | )  <  |  A. 

n '  ^  s,t  ( s  t )  ^  j=l  i=l  1 


<  R 


(3) 


Proof:  Since  |X^|  =  a. j  ,  the  inequality  on  the  left  follows 
from  6:0  (16)  and  Theorem  11:4:4  (1).  The  inequality  on  the 
right  is  6:0  (7). 

□ 


(b)  For  |Aj  =  min  | 
Given  A  , 


| An|  £  min  Ri  .  (4) 

Proof:  Since  A  is  normal,  a  =  I A  I  Now  (4)  follows 
-  »  n  1  n1 

from  11:4:4  (10). 

□ 
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(d)  For  the  spread: 
If 


is  real  then: 


(5) 


31/2  v  <  sp(A) 


(6) 


where. 


2 

v 


1  r  ,  2  2 

-  n  l  Si  -  m 
1 


m  =  —  y  S. 
n  v  i 

l 


Further,  if  S.  ,  i  =  1 ,2 ,  • • •  ,n  are  ordered  so  that 


±Si 


9 


(7) 


then: 


\  (si.'si  .  ,)2 
3=1  J  n-j+1 


1/2 


<  sp(A) 


Proof.  See  [23]. 


(8) 


□ 


(e)  For  sum  of  eigenvalues: 


With  R.j 


(9) 


(10) 


r  '  :  :  .T.  ! 
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Proof:  As  A  is  normal  the  above  results  follow  from  6:0 
(19)  and  6:0  (20). 


v 
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Given  normal  A  ,  clearly  results  of  Chapter  7  hold.  Further, 
the  equality  conditions  given  in  Chapter  7  become  applicable.  In  addition 
we  have  the  following  result  for  the  condition  number: 


(h)  For  the  condition  number: 


If  det  A  i  0  then: 

2  s 


1  + 


A 


X 


(tr  A  A/n) 


172 -IT 


<  t: — r  =  c(A)  , 


n 


(1) 


where. 


2  *  i  1 2 

m  =  tr  A  /  n  and  s^  =  tr  AA  /  n  -  |m| 


Furthermore,  if 


tr  A| 2  >  (n-1 )  tr  AA  , 


then 


I T I 

c(A)  =  ttt  <  1  + 

I  An  I 


(Zn)1/2  s 


A 


I m |  -  sA(n-l) 


1/2 


(2) 


Proof:  See  [63]. 


□ 


. 


' 


'  -  ■  ■  rh 


>  —  ~  I  ■;  5  .  ■  '  < 

. 
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Given  that  a  normal  matrix  A  has  real  eigenvalues  then  A  is 
necessarily  Hermitian  (see  Theorem  0  (2)). 


□ 


1:11:9.6.1 
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Given  R.  =  £  a.  .  ,  i  =  l,2,-*-,n  and  tr  A  ,  we  have  the 

1  J  1J 

following  bound  for  the  spread: 


(d)  For  the  spread: 

Given  A  , 


— y  I  I  Rn-  -  tr  A|  <  s p ( A)  . 


Proof:  See  [23]. 


□ 


tbes'tqz  s>rt$  id  (b) 


CHAPTER  12 


HERMITIAN  MATRIX 


§12:0  Prel iminaries. 

•k 

The  matrix  A  is  called  Hermitian  if  A  =A  .  In  case  a 
Hermitian  matrix  is  real,  it  is  known  as  a  symmetric  matrix.  All  the 
eigen  values  of  a  Hermitian  matrix  A  are  real.  For,  if  Ax = Ax  then, 

A(x,x)  =  ( Ax,x)  =  ( x,Ax)  =  A(x,x)  . 

Throughout  this  chapter,  we  shall  assume  that  the  eigenvalues  of  A  are 
ordered  as: 


A1  ix2-'"  —  An 


0) 


Given  A  Hermitian,  it  is  clearly  normal.  Thus,  for  A  Hermi¬ 
tian,  all  the  results  of  Chapters  8  and  11  hold.  In  particular,  we  have 
the  following: 

Theorem  1 :  If  A  is  Hermitian,  then  it  has  a  set  of  orthonormal  eigen- 

•k 

vectors,  i.e.  A  =  UDU  ,  where  U  is  unitary  and  D  =  diag(A^ jA^,*** jA^) 

□ 

Theorem  2:  Given  A  Hermitian,  we  have 


A1  ’  X2 


=  A 


(2) 


if  and  only  if  A  is  a  real  scalar  matrix. 


□ 
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In  addition,  a  Hermitian  matrix  has  other  very  useful  proper¬ 
ties.  First,  we  shall  define  the  Rayleigh  quotient: 

Defintion  3.  Given  A  Hermitian  and  a  vector  x  f  0  then 


p(x) 


(x,Ax) 


(3) 


is  called  the  Rayleigh  quotient.  □ 

Since  for  any  x  e  f  ,  (x,Ax)  =  (Ax,x)  =  (x,A  x)  =  (x,Ax)  ,  we 
conclude  that  p(x)  is  always  real. 


Now,  we  shall  prove  the  well-known  Rayleigh's  principle  relating 
the  eigenvalues  of  A  and  the  Rayleigh  quotient. 


Theorem  4.  If  the  Hermitian  matrix  A  has  eigenvalues. 


X-j  >_  >.  •  •  • 


3 


then,  for  any  x  e  (fn  , 


An  1  p(x)  1  X-, 


(4) 


and 


A-,  =  max  p(x) 
x^O 


max 

x^O 


(x,Ax) 

(x,x) 


A 

n 


=  min  p(x)  =  min 
x^O  x^O 


(x,Ax) 

(x,x) 


(5) 


Proof:  Let  x^  ,  i=l,2,***,n  be  a  set  of  orthonormal  eigenvectors  of 
A  ,  such  that  Ax^  =  X^x^  .  Then,  for  any  x  ,  x  =  \  a- x..  for  some 

scalars  a.  ,  i  =  l,2,***,n  ,  and  moreover,  we  have. 


/ 


IF 


1:12:0 
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Clearly, 
p(x-,)  = 

Theorem 

•  •  •  >  A 

—  n 

[42,  pg. 

Theorem 


Ax  =  y  a.  Ax. 
4  i  i 


y  a  .A .  x . 

tj  ill 

£l“i  1% 

l  Kl2 


p(x)  <_  A-j  and  p(x)  >_  An  .  Finally,  (5)  follows  noticing  that, 
A-,  and  p(xn)  =  An  .  □ 

More  generally,  we  have  the  following: 


5_.  Let  A  be  a  Hermitian  matrix  with  eigenvalues,  A^  _>  A^ 
and  corresponding  orthonormal  eigenvectors  xi,x2,#**,xn  *  Then: 

A,  =  max  p(x)  . 

(x,xi)=0 

i=l ,2,--- ,k-l 


Next,  we  state  the  well-known  Courant-Fisher  Theorem  (e.g.  see 
4141): 


6:  (Courant-Fisher  Theorem).  Given  Hermitian  A  , 


A.  =  max  p(x) 
1  x^O 


Ak  ■ 


max 


mi  n 


I iyi I  1=1  (x,yi)=0 

i=l  ,2 , • • • , k- 1 


P ( x )  ,  k  =  2 ,3, • • •  ,n 


(8) 


A  =  min  p(x) 
n  x^O 


< 


i  -•  m.  i  -  >.1;  .  !■  i  c 


•  -r 
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min  p(x)  ,  k  =  2,3,*** ,n  .  (9) 

(x,y • )=0 

□ 

Finally,  we  give  the  interlacing  theorem  for  a  Hermitian  matrix: 

Theorem  7:  Given  Hermitian  A  ,  let  A.  be  its  principal  submatrix 
obtained  by  deleting  the  ith  row  and  column  and  X^(A. )  >_  X ^ ( A n- )  ^  •••  >_ 
A  .j(A. )  ,  be  the  eigenvalues  of  A...  Then: 

,  k  =1 ,2,  •  •  •  ,n-l  .  (10) 


A 


n-k+1 


max 

I lyi I l=i 

i=l,2,---,k- 


Proof :  The  principal  submatrix  A.  is  Hermitian  of  order  (n-1)  .  Thus, 
from  (7)  we  have. 


A,  (A. )  =  max 
K  1  x^O 


(x^.x) 
(x,x)  5 


(11) 


where  x  is  a  (n-1)  vector.  Now,  if  y  =  (y.)  is  such  that 
yj  =  xj  5  J  <  1  >  yi  =  0  and  yj+i  =  xj  >  i  l1’  »  then  from  (?)> 


A^  _>  max 

y 


(y>Ay)  = 

(y,y) 


A, 


(Ai) 


5 


which  establishes  the  inequality  on  the  right  in  (10). 


To  obtain  the  inequality  on  the  left  in  (10),  we  shall  employ 
the  Courant-Fisher  Theorem:  From  (9),  we  have 


A,  (A.) 
k  v 


max 

I iyi I l=i 

i=l  ,2,** • ,n-l-k 


(x,A.x) 


mi  n  —7 - r 

(x,yi)=0  (x’x) 


(12) 


\ 
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where,  x  and  y.  are  (n-1)  vectors.  Also, 


max  min 

I  I v^.  |  |=1  (u,vi)=0 

i=l  ,2,* • • ,n-l -k 


(u,Au) 
(v  ,Av) 


(13) 


Now,  considering  vectors  u  ,  with  zero  ith  component,  in  (13), 
we  essentially  maximize  over  vectors  v  •  whose  ith  components  are  zero. 
Thus,  (10)  follows.  □ 


Remark  8.  Since  a  Hermiti an  matrix  A  is  normal,  we  have, 


o.  =  |X. |  ,  i  =  1 ,2, • • •  ,n 


Therefore,  we  shall  not  mention  results  for  the  singular  values  explicitly. 
Also  we  note  that  for  Hermiti an  A  , 


tr  A2  . 


□ 


"■  <  *'  . .  •-  7  .  ; 


. 

1:12:2 
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§12:2 

In  this  section  we  shall  give  results  which  involve  only  the 
diagonal  elements  of  a  Hermitian  matrix.  We  note  that  the  diagonal 
elements  of  a  Hermitian  matrix  are  always  real. 

The  inequalities  (1)  and  (2)  below,  are  immediate  from  Theorem 

(4). 


(a)  For  A-j  =  max  X.  : 

i 

Let  A  be  a  Hermitian  matrix.  Then 

max  a . .  <  A,  (1 ) 

•  n  —  1 

□ 


(b)  For  A  =  min  A.  : 

n  .  i 

Given  Hermitian  A  , 

A  <  mi  n  a . . 
n  —  .  n 

(d)  For  the  spread: 

Given  A  Hermitian, 

2  max  |  a  -  - 1  £2  max  |a..|  £  sp(A) 

•  II  •  •  I  J 

i  i ,  J 


(2) 

□ 


Proof:  See  [41]. 


□ 


- 


< 


- 
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Recall,  that  if  x  =  (x. )  and  y  =  (y. )  are  any  two  real 
vectors  then  y  is  said  to  majorize  x  if 

k  k 

x(i)  <  ^  y(i)  ,  k  =  l,2,  —  ,n  ,  (4) 

and  equality  holds  for  k  =  n  ,  where  x^.j  ,  y^  are  components  of  the 
vectors  x  and  y  arranged  in  decreasing  order.  Further,  if  y  major¬ 
izes  x  ,  we  write 

x  <  y  .  (5) 

(e)  For  sum  of  eigenvalues: 

The  following  result  is  given  in  [32,  pg.  218]: 

Given  Hermitian  A  ,  let  a  and  X  be  two  vectors  such  that 
a  =  (a..)  and  A  =  (A.)  .  Then: 

a  <  A  .  (6) 

Proof:  Without  loss  of  generality,  we  let  a^  >_  >_•••>_ 

a  and  for  1  £  k  £  n  define  A,  =  (a.  .)  ,  i  ,j  =  1 ,2,*««  ,k  . 
n  n  k  i  j 

Let  the  eigenvalues  of  A^  be  A^(A^)  >_  A^A^)  —  ”  —  * 

Then  from  Theorem  0(7),  for  1  £  k  £  n-1  , 

VAk+l^  -  W  -  VAk+l^  -  -  W  -  Vl^k+l^  * 


Thus,  by  definition  of  trace. 


. 


^  f  t  ■  u 


a  fc  ft 

* " 


«  *  -n  *  "Ot  ,<\>o  -uno;.  .  ~so^  • '  •* 


:  '•  *r  ^  ,2'. .IT 
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k 


l  MA  ) 
i=l  1  K 


•  ^  VAk+l^ 


Finally,  since  tr  A  =  J  a..  =  J  A.  , 

•  11  •  1 


□ 


(6)  follows. 


' 
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§12:3.1 

Given  tr  A  and  tr  the  results  of  §8:3.1  hold, 
we  have  the  following: 

(c)  For  Ak  : 

If  for  Hermitian  A  ,  tr  A  >_  0  and 

tr^A  _>  (>)  (n-1 )  tr  P?  , 

then  A  is  positive  semidefinite  (positive  definite). 

1  (>)  0  ,  k  =  1 ,2, • • • ,n  . 


Proof:  It  is  shown  in  [63]  that 


A  >  tr_A  .  (trj?  .  tAy/Z  (n-l)1/2 


n  —  n 


n 


2  ) 
n  / 


which  is  nonnegative  (positive)  if  (1)  holds.  Thus  the 
follows. 


(h)  For  the  condition  number: 


If  for  Hermitian  A  ,  tr  A  >  0  and 
then  A  is  positive  definite  and 


n  -  (tr  A)2 
P  p 

tr 


-  (n- 


1  + 


2s 

m - s/(n-l ) 


1 j2  —  C(A) 


|Xi 1  i  +  q-p2)1/2 
'Xn'  ~  P  . 


5 


2  2  2 

where,  m  =  tr  A/n  and  s  =  tr  A  /  n-m  .  When  n  > 
equality  holds  on  the  right  if  and  only  if. 


addition. 


(1) 

That  is. 


resul t 

□ 

>  0  , 

(2) 

2  , 


. 

:Tj  •'  )  $;\i  \ 

-4^  - — 1  ■  o  jfff  0  <  A  i$  \  A  ri&tetmrti  lo'i 


1:12:3.1 
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A 

and  then 

For  n  >  2 
even  and  A 

Proof:  See 


2  2 
A/  +  A 
1  n 

A,  +  A 

n 


3 


tr  A2 

tr  A 


A,  +  A 


equality  holds  on  the  left  if  and  only  if  n  is 
is  a  scalar  matrix. 


[63]. 


□ 


» 


\ 
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§12:6 

Given  the  row  sums  of  a  Hermitian  matrix  we  have  the  following 

results: 

(a)  For  X,  =  max  X.  : 

I  •  I 

i 

Given  Hermitian  A  , 


I  R-j  /  n  £  X1  .  (1 ) 

i 

Proof:  Inequality  (1)  is  immediate  from  0(5)  when 
x  =  (1 ,1  ,  •••  ,1 ) 1  .  It  is  shown  in  [36]  that  (1)  is  a  particu¬ 
larly  good  estimate  for  a  nonnegative,  irreducible  symmetric 
matrix.  □ 


(d)  For  the  spread: 


Given  A  Hermitian,  let 


si  =  l  a.j  ,  1=1,2,... ,n 

0 


If  s.  ,  i  =  l,2,***,n  are  real  then 


2v  <  sp(A)  , 


(2) 


where. 


m  =  T  S.  /  n  and  v^  =  —  7  S.^  -  m^ 
j  l  n  4*  l 


Further,  if  S.  ,  i  =  l,2,**«,n  are  ordered 


s.  >  s .  >  •  •  •  >  s . 

nl  ”  ^2  “  ]n 


* 
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then: 


2 

« — 
n 


r^j 


l  (s,  -s.  )' 

j=l  n-j+1 


1/2 


1  sp(A) 


Proof:  See  [23] . 


(3) 

□ 


1:12:6.2 
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§12:6.2 

The  result  below  is  given  in  [26,  pg.  2261.  It  provides  a 
criteria  for  checking  if  a  Hermitian  matrix  is  positive  definite. 

(c)  For  Ak  : 

If  the  diagonal  elements  of  a  Hermitian  matrix  are  all  positive 
and  A  is  diagonally  dominant,  i.e. 


(1) 


then,  A  is  positive  definite,  that  is  A.  >  0  ,  k  =  1 ,2, • • •  ,n  . 


Proof:  The  diagonal  elements  of  a  positive  definite  matrix  must 
be  positive,  for  0  <  An  £  min  a^.  .  Further,  from  the  Gersch- 
gorin's  Theorem  (see  §6:2)  any  eigenvalue  A  of  A  satisfies 
a..  -  A  <  P.  =  |  ,  for  some  1  <  i  <  n  .  Thus,  from  (1) 


j*i 


each  A  >  0  .  Hence  the  proof. 


□ 


1:12:10.2 
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§12:10.2 

Given  a  nonnegative  symmetric  matrix,  then  we  have  the  following 
result  for  the  sum  of  eigenvalues: 

(e)  For  sum  of  eigenvalues: 

If  the  diagonal  elements  a.^  ,  and  the  eigenvalues  X.  , 
i  =  l,2,***,n  of  a  nonnegative  symmetric  A  are  ordered  as. 


al  ia2  i  •"  —  an 


and 


>  X 


n 


then: 


s 


s-1 


(1) 


Proof:  See  [6,  pg.  97] 


□ 


.f  .!  .go  ,3;  too-iq 


CHAPTER  13 


POSITIVE  DEFINITE  ( SEMI  DEFINITE)  MATRIX 


§13:0  Prel iminaries. 

Given  an  n*n  matrix  A  ,  it  is  called  positive  definite,  if 
A  is  Hermitian  and 


(x,Ax)  >  0  ,  for  all  0  f  x  e  tn  .  (1) 


In  case, 

(x,Ax)  >  0  ,  for  all  x  6  (fn  , 

we  say  that  A  is  positive  semi  definite.  Below  we  give  some  necessary 
and  sufficient  conditions  for  a  matrix  to  be  positive  definite  (semidefi- 
nite) . 

Theorem  1 :  Given  an  n*n  matrix  A  ,  the  following  are  equivalent: 

(i)  A  is  positive  definite  (semi definite) ; 

(ii)  A  is  Hermitian  and  all  its  eigenvalues  are  positive  (nonnega¬ 

tive)  ; 

(iii)  A  is  Hermitian  and  all  its  leading  principal  minors  are  posi¬ 

tive  (all  principal  minors  are  nonnegative). 

Proof:  Let  A  be  positive  definite  (semidefini te) .  If  X  is  an  eigen¬ 
value  of  A  with  corresponding  eigenvector  x  then  we  have  (x,Ax)  = 

X(x,x)  >  (>)  0  ,  which  is  so  only  if  X  >  (>)  0  .  Thus  (i)  implies  (ii). 
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. 


for  *“t,rsv  f  >t‘r  ff|  bn s  -  itthruH  A  \  (\'t)  - 


I  •  -.n  !:l  f  •  !"YQ  ' 
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Conversely  let  all  the  eigenvalues  of  A  be  positive.  Then  from  12:0  (5) 

( x  Ax ) 

we  have  X  =  min  -V2 — r  »  where  A  is  the  smallest  eigenvalue  of  A  . 
n  x^0  U,  x)  n 

Therefore,  (x,Ax)  >  (>_)  0  .  Further,  if  D  is  any  Hermitian  matrix  then 
so  is  any  principal  submatrix  of  D  .  Also,  from  the  interlacing  theorem 
(see  Theorem  12:0  (7))  if  all  the  eigenvalues  of  D  are  positive  (nonnega¬ 
tive)  then  so  are  the  eigenvalues  of  any  principal  submatrix  of  D  .  From 
this  we  get,  (i)  implies  (iii).  Conversely,  if  all  the  leading  principal 
minors  of  A  are  positive  then  by  induction  one  can  show  that  A  is  posi¬ 
tive  definite  (e.g.  see  [39,.  pg.  401]).  For  the  positive  semidefinite  case, 
see  [39,  pg.  405].  □ 

Next,  we  give  some  well-known  properties  of  a  positive  definite 
(semidefinite)  matrix. 


Theorem  2.  Given  a  positive  definite  (semidefinite)  matrix  A  ,  then: 


(i)  ai-j  >  (l)  0  ,  1  =  1 ,2,*“,n 


(2) 


(ii) 


Further,  if  A  is  positive  semidefinite  and  a 
some  1  £  k  £  n  ,  then  each  element  in  the  kth 
column  of  A  is  zero; 


^  is  zero  for 
row  and  kth 


(iii)  a...  a..  >  (>)  |  a  i  ^  | 2  ,  i  f  j  ,  1  <  i  ,  j  £n  :  (3) 

(iv)  there  exists  k  ,  1  <  k  <  n  such  that, 


akkl  1  laij  I  •  1£i  •  J<" 


(4) 


(v)  det  A  >  (>)  0  ; 


(5) 


N. 


•  fci  r  .  . 


<  -  {?  r '  .  -  c)  urY  ^  ,,v  .  -  .,;  -  n  •  .:  -  ••  7 


n  r*'VS«i  •  ,  C  (  f  ...  .f  ^ 


-  ..  -•.  :  t  .  — Y  '  i  -  ;  - 


\ 
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and, 

(vi)  if  tr  A  =  0  then  A  =  0  . 

Proof:  For  positive  semi  definite  A  ,  inequalities  (2)  and  (3)  are  clear 

from  the  previous  theorem.  If  a^  =  0  for  some  1  £  k  £  n  ,  it  follows 

from  (3)  that  each  element  in  the  kth  row  and  kth  column  of  A  is  zero. 

Further,  if  A  is  positive  definite,  then  each  principal  minor  of  A  is 

positive  (see  e.g.  [31  ,  pg.  70]).  Thus  (2)  and  (3)  follow.  The  inequality 

(4)  is  clear  from  (3);  and  (5)  follows  from  Theorem  (1).  Finally,  if 

tr  A  =  l  a..  =  0  ,  then  using  inequality  (4),  we  get  A  =  0  .  □ 

i  11 

Since  the  eigenvalues  of  a  positive  definite  (semidefinite) 
matrix  are  positive  (nonnegative)  and  therefore  real,  we  shall  always  assume 
that  they  are  ordered  as: 


^1  rl  ^2  —  *  *  *  -  ^n  (6) 

Remark  3.  Given  a  positive  semidefinitematrix  A  ,  the  singular  values 
equal  the  eigenvalues,  i.e., 


a.  =  X.  ,  i  =  1 ,2,-»*  ,n  . 

Also,  if  A  is  positive  definite, 

c(A)  =  A1  /  An  . 

Finally,  we  present  the  Kantorovich  inequality: 


(7) 


(8) 

□ 


Theorem  4.  (Kantorovich  Inequality).  If  A  is  positive  definite  then: 


- 


x  I  *1  '<  r  SO  M?  i  /  -rhx  #>v  i .  .£  *  v  %.•'! 


.  •  ~ 


' 
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1  <  (x,Ax)(x,A'1x)  <  |  [(X1/Xn)1/2  +  (Xn/X1)1/2]Z  ,  (9) 

for  all  x  such  that  ||x||  =1  . 

Proof:  See  [31,  pg.  117].  An  alternate  proof  involving  Lagrange  multi¬ 
pliers  is  given  in  [62],  □ 


1:13:1 
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§13:1 


Given  the  trace  of  a  positive  semi  definite  matrix  A  ,  we  have 
the  following  result: 


(c)  For  Ak  : 

Given  A  positive  semi def ini te, 

£  tr  A  /  k  ,  k  =  l,2,***,n  .  (1) 


Equality  holds  if  and  only  if 


A,  =  A„  = 


=  A.  and  A 


k+1 


=  A  =  0 


Proof:  Since  A  is  positive  semi  definite,  we  have  A.  _>  0  , 
i  =  1 ,2,*#*  ,n  .  Thus,  tr  A  =  £  A^  £  k  A^  ,  from  which  (1 ) 

follows.  The  conditions  for  equality  are  clear.  □ 


1:13:2 
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§13:2 

Given  the  diagonal  elements  of  a  positive  semi  definite  matrix,  we 
have  the  following: 


(a)  For  =  max  : 

Given  A  , 

max  a..  £  A,  £  max  a..1^2  I  a..1/2  .  (1) 

i  11  1  i  11  j 

Proof:  From  13:0  (3)  we  have  l  laijl  £  a..."^2 -I  ajj  ^  •  Now 

the  inequality  on  the  right  follows  from  6:0  (7).  The  inequal¬ 
ity  on  the  left  is  12:2  (1).  □ 


( f )  For  product  of  eigenvalues 


Let  the  diagonal  elements  of  a  positive  semi  definite  matrix  be. 


all  —  a22  -  "•  iann 


Then : 


n  n 

JI  A.  £  n  a. .  ,  k  =  1 ,2,**«,n  .  (1) 

k  1  k  1 

In  particular,  we  have  Hadamard's  inequality, 

det  A  =  n  A.  <  I  a. .  .  (2) 

i  1  -  i  11 

Equality  holds  in  (2)  if  and  only  if  A  is  a  diagonal  matrix 
or  A  has  a  zero  row  and  column. 

Proof:  See  [32,  pg.  223].  □ 


' 


.*  te  it  J*  v-(l;  a  Q  ?Jn9ffl»f9  Fttiibp*  i  t> '*d  J  9j 


< 
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(h)  For  the  condition  number: 

For  a  positive  definite  matrix  A  , 

max  a..  ^ 

1  <  -} -  £  4  =  c(A)  .  (3) 

mi"  aii  n 

Proof:  Inequality  (3)  is  immediate  from  12:2  (1)  and  12:2  (2), 
since  >  0  .  □ 


< 

! 
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§13:3.1 

2 

Given  positive  definite  A  ,  tr  A  and  tr  A  ,  we  have  the 
following  bounds  for  the  condition  number. 


(h)  For  the  condition  number: 


Given  positive  definite  A  ,  let  m  =  tr  A  /  n  and 
2  2  2 

s  =  tr  A  /  n  -  m  .  If  n  is  even,  then: 


1  + 


2s 


m  -  s(n-l  )"'1//2  An 


'  t-  =  c(A) 


(1) 


When  n  >  2  equality  holds  if  and  only  if  A  is  a  scalar 
matrix.  Further,  if  n  is  odd  then  (1)  holds,  but  moreover. 


2sn /  (n2-1)1/2  <  = 

m.s/(n.l)1/2  ~xn 


c(A)  . 


(2) 


When  n  =  3  equality  holds  if  and  only  if  the  two  smallest 
eigenvalues  are  equal.  For  n  >  3  equality  holds  if  and  only 
if  A  is  a  scalar  matrix. 


Proof:  See  [63]. 


□ 


V  , 


.  fjcups  9ts 


' 


\ 
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2 

Given  tr  A  and  the  diagonal  elements  of  a  positive  definite 
matrix,  we  have  the  following  bounds  for  det  A  : 

(f)  For  product  of  eigenvalues: 


(i)  Given  positive  semidefinite  A  , 


n  a..  - 
•  n  n-2 


n-2 


tr  A^  -  I  a . 

1 


11 


<  det  A  . 


0) 


Proof:  See  [32,  pg.  224]. 


□ 


(ii)  Given  positive  definite  A  , 

det  A  <  IT  a.,  -Ann_1(tr  A2  -  l  a..2) 

<  n  a..  -  (tr  A  /  n)n_1 (tr  A2  -  l  a.,2)  . 

i  1 1  i  1 1 

Proof:  The  inequality  on  the  left  is  given  in  [30],  and 
the  inequality  on  the  right  follows  using  ^  <  tr  A  /  n  .  □ 


For  the  next  result  we  need  the  following  notation: 


Let  the  diagonal  elements  of  A  be  ordered  as. 


al  -  a2  -  ■”  -  an  5 


A,  = 


k 

,2, 


l-i,  =  tr  A  -  l 


1=k+l 


3 


(2) 


V  •  -  v  ?  i  ( 1  ■ 


•  .  I  r r*  *  ^  ^  r  (n  V  %  #)  -  .  .  s  a  : 


•  '  •  ,  "  v* .  .iJusn’r  :  r 

.  \ 
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\ =  Vk  •  sk2  =  Lk/k  -  mk2 


(3) 


n 


i 

1=n-k+l 


a . 


l 


n-k 


(4) 


m  k  =  A  u/k  and 


=  L-k/k  -  m-k 


(5) 


(ii)  Given  positive  definite  A,  let  °°  =  a  >  a,  >  •••  >  a  >  a  ,,  =  - 
K  o  —  1  —  -  n  —  n+1 

contain  the  ordered  diagonal  of  A  .  Further,  let 


and 


sk/(k-l)1/2  , 

(6) 

sk(k-l)1/2  , 

(7) 

s.j/(j-l)1/2  , 

(8) 

b-j  =  m-j  -  s-j/(j'1)1/2 


(9) 


Then  there  exist  integers  t  and  r  such  that  pk 

»  P _ j  ^  »  j  -  n ,n-l , •  •  • , r+1  , 

and  we  get 


>  ak  ,  k  =  n,n-l ,••• ,t+l, 

a  >  q  >  a  ,,  , 
n-r  —  -r  —  n-r+1 


det  A  <  utCpt)t_1  at+1  •••  an 


-  vf  pt+l  )*  dt+l  an 


<  u  (p  ) 
-  nVKn' 


n-1 


(10) 


Equality  holds  throughout  the  first  j  inequalities  if  =  •••  =  X  = 
=  At+j_i  and  At+j+i  =  at+j+i  »  i  =  0 ,1 , • • • ,n-t-j  ,  in  this  case 

^2  =  Pt+j-l  and  ^1  =  Ut+j-l  *  Fur't:der 


,1  7  ■*  .  .  l,  r  be  :9b*io  9n*  riff:?  jo  m 


1 


■ 

, 
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det  A  >  b  (q  )r  ^  an  •••  a 

-  -r  -r  1  n-r 


1  b-(r+l)(q-(r+l))  al  ”■  an-r-l 


•  •  • 


>  b  (q  ) 

-  -n  -n' 


n-1 


(ID 


Equality  holds  throughout  the  first  j  inequalities  if  and  only  if 


X 


n-1 


~  00 


=  X 


n-r 


=  X  and  X.  =  a.  ,  i  =  l,«*»,n-r-j  ,  in 

n-r-j+1  i  i 


this  case  X  ,  =  q  ,  ,  M  and  X  =  q  ,  ,  M 
n-1  -(r+j)  n  -(r+j) 


Proof:  See  [17]. 


□ 


A  procedure  for  calculating  the  above  bounds  for  det  A  is 


also  given  in  [17] . 


1:13:6 
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In  this  section  we  shall  give  results  which  involve  row  sums  of 
a  positive  definite  (semi definite)  matrix. 

(c)  For  : 

Given  A  positive  semidefinite,  let  R.  -  J  |aij|  be  arranged  as 

R.  >  R.  >  •••  >  R.  .  Then: 

11  ^  ]n 

k-1 

Ak  -  Ri.  '  l  mjn  K'.d  lRik  ’  k  =  ’  (11) 

k  j=l  36  j 

Proof:  For  k  =  1  the  result  is  known  (see  6:0  (7)).  Let 

A.  •  #  .  denote  the  principal  submatrix  obtained  by  deleting 

12  k 

the  rows  and  columns  i-j  ,i?,**«  ,i^  .  Then  by  repeated  applica¬ 

tion  of  12:0  (10)  we  have. 


Xk+1  -  X1  ^ Ai ^ i 2  —  i k ^  ’  k  • 


Now  from  6:0  (7), 


X,  (A.  .  .  )  <  R1-  • 

i  1  -|  ‘2  'k  'v2  k 

where  R1?  .  ,  j  =  1 ,2, •  •  •  ,n-k  ,  are  the  row  sums  of 

1  1  •  •  •  1  J  J 

V2  k 

A.  .  .  arranged  in  decreasing  order.  However, 

’lV’k 

i  k 

R.  •  •  <  R.  -  y  min  la.. 

1 1  2  k  Vl  j=l  ^  £  j 

k 

=  R .  -  J  mi  n  |  a .  .  |  , 

k+1  j=l  36  j 


□ 


which  completes  the  proof. 


•  •  • 


-f 
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§13:6.2 

Given  the  row  sums  and  the  diagonal  elements,  of  a  positive 
definite  matrix,  we  have  the  following  result  for  the  condition  number: 

(h)  For  the  condition  number: 

Given  A  positive  definite. 


where 

max  R.  , 

•  l  X, 

-TTo - lr=  c(A)  ,  (1) 

min  a^.  An 

R.  =  T  1  a .  .  1 

1  i  1J 

Proof: 

1  /2 

Since  ,  from  6:0  (16)  we  have  max  R.  /  n  < 

A,  .  Also,  from  12:2  (2),  0  <  A  <  min  a..  .  Now  (1)  follows. 

1  v  '  n  —  .  n 

□ 


- 


w 
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§13:7.1 


In  this  section  we  shall  give  results  which  involve  the  deter¬ 
minant  and  the  trace  of  a  positive  definite  (semidefinite)  matrix. 

(a)  For  X-|  =  max  X.  : 

i  1 

Given  positive  semidefinite  matrix  A  f  0  , 


(n/tr  A)n~"'  det  A  £  det  A  £ 


L1 


and 


A 


1  £  tr  A  -  (n-l)(det  A/A-j ) 


1/n-l 


<  tr  A  -  ( n-1 ) ( det  A/tr  A)^n  ^ 


(1) 


(2) 


Proof:  Applying  the  arithmetic-geometric  mean  inequality  to 
nonnegative  eigenvalues  A^jA^,***^  ,  we  have, 

/tr  A  -  x-.\n-l 

det  A  /  A-,  £  ( - ,  (3) 

from  which  the  inequalities  on  the  right  of  (1)  and  left  of 
(2)  follow.  They  are  also  proved  in  [7,  pg.  69].  The  inequal¬ 
ities  on  the  left  of  (1)  and  right  of  (2),  now  follow,  since 
tr  A  /  n  £  A^  £  tr  A  .  □ 

The  following  result  for  An  can  be  proved  similarly: 

(b)  For  An  : 


Given  a  positive  definite  matrix  A  , 


' 


' 


.  A  iS 

—  I 
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(Fl)"'1  det  A  1  (tFlFT)"'1  det  A  <  An  ;  <4> 

n 


and 


X„  <  tr  A-(n-l)(^)1/n-1  <  tr  A  -  (n-1 


n 


(5) 

□ 


The  results  below,  follow  from  (1),  (2),  (3)  and  (4) 


(d)  For  the  spread: 


Given  a  positive  definite  matrix  A  , 


sp(A)  <  tr  A  -  (n-l)(|^)1/n'1  -  (tAt)"'1  det  A  ; 


tr  AJ 


and 


det  A+tn-ntL^)1/"-1  -  tr  A<  sp(A) 


(h)  For  the  condition  number: 


For  positive  definite  A  , 


/  n  %n-l  ,  ,  n 
<tF A>  det  A 


„  /  -i  N  / n  det  A  J/n 

tr  A  -  (n-1 )  (  tr  A'  ) 


^1 

=  C<A> 


< 


tr  A-fn-lX^!)1/"-1 


-  ^-1  ^  n-1  j  ^  „ 

<tFA>  det  A 


□ 


□ 


it 


t  9+  n  tab  svr;  >oq  6  nsvi 


< 
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§13:7.2 

In  this  section  we  shall  give  results  which  involve  the  determi¬ 
nant  and  the  diagonal  elements  of  A  .  Since  0  <  max  a....  £  and 

0  <  A  £  min  a..  ,  inequalities  (1)  and  (2)  below,  follow  from  7.1  (1) 
n  ^  ii 

and  7.1  (5). 

(a)  For  A,  =  max  A.  : 

I  •  i 


Given  posi tive  semidefinite  A  f  0  , 


A 


1 


(1) 


□ 


(b)  For  A  =  min  A.  : 

n  .  l 


Given  positive  definite  A  , 


□ 


The  following  result  is  given  in  [29]: 


(h)  For  the  condition  number: 


Given  A  positive  definite,  let 


q  =  4  c(A)  /  (c(A)  +1)2 


Then: 


q11-"*  n  a . .  £  det  A  , 

•  i  ’ 


(3) 


with  equality  if  and  only  if  A  is  a  scalar  matrix. 


□ 


■ 


t*b 


■ 


• 


' 


;  #s -rnr"  5b  ^vrJfeoq  A  r;  v;3 
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13:7.3.1 
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Given  tr  A  ,  tr  A  and  det  A  ,  for  a  positive  definite  matrix 
A  ,  we  have  the  following  upper  bound  for  the  condition  number: 

(h)  For  the  condition  number: 

Let  A  be  positive  definite,  and  m  =  tr  A  /  n  and 
s^  =  tr  A^  /  n  -  m^  ,  then: 

b  ■  C(fl)  <  1  +  (2n)1/2s,.[mt._s_/Ln-lI1./lL  . 

^n  det  A 


Proof:  See  [63], 


□ 
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CHAPTER  1 


SPECTRAL  RADIUS 


§1:0  Preliminaries. 


Given  an  nxn  matrix  A  ,  let  A-  ,  1  <_  i  £  n  be  its  eigen¬ 
values.  Then, 


p ( A)  =  max  | A. 

•  I 


(1) 


is  called  the  spectral  radius  of  A  .  The  bounds  for 
under  the  heading  (a)  in  the  chapters  of  Part  I.  In 
shall  study  the  relation  between  the  spectral  radius 
and  give  some  results  which  are  not  included  in  Part 


p ( A)  are  given 
this  chapter  we 
and  the  norm  of 

I. 


A 
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§1:1  Matrix  Norms. 

Given  a  square  matrix  A  of  order  n  ,  its  matrix  norm  is  a 
nonnegative  number  denoted  by  ||A||  ,  associated  with  A  ,  such  that: 

(i)  |  | A |  |  _>  0  ,  with  equality  if  and  only  if  A  =  0  ; 

(ii)  | | cA | |  =  | c |  | | A| |  for  any  scalar  c  ; 

( i i i )  || A+D ||  £  | | A | |  +  | | D | |  ;  and 

(iv)  | | AD | |  £  | | A | |  | | D | |  ,  where  D  is  any  matrix  of  order  n  . 

However,  matrices  usually  occur  in  conjunction  with  vectors  and  it  is 
convenient  to  define  a  matrix  norm  so  that  it  is  compatible  with  a  vector 
norm,  in  the  following  sense: 

Definition  1:  A  matrix  norm  is  said  to  be  compatible  with  a  vector  norm 

| | x | |  i f  | | Ax | |  £  | | A | |  | | x | |  .  □ 

The  following  result  is  well-known: 

Theorem  2:  Given  a  matrix  A  of  order  n  ,  then 

| | A | |  =  max  | | Ax | |  ,  (1 ) 

I  I x | |=1 

defines  a  matrix  norm.  □ 

Note  that  the  norms  on  the  right  of  (1)  are  vector  norms. 

Definition  3:  A  matrix  norm  defined  by  means  of  (1)  is  called,  a  matrix 
norm  induced  by  or  subordinate  to  the  vector  norm.  □ 


. u,.9  ...  .1  .  .  '•  n 


\ 
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Clearly  any  matrix  norm  which  is  induced  by  a  vector  norm  is  compatible. 
The  most  commonly  used  subordinate  matrix  norms  are  the  ones  associated 
with  the  1,2  and  °°  vector  norms.  Below,  we  obtain  their  explicit 
representations : 

Theorem  4.  The  matrix  norms  subordinate  to  the  1,2  and  00  vector  norms 
are 

I |A|  U  =  max  l  I  a,,  I  ;  (2) 

i  j  i  ij 

llAli^o,  ,  (3) 

where  a-j  is  the  largest  singular  value  of  A  ; 

I  I  At |ro  =  max  l  | a  . . |  .  (4) 

i  J 

Proof:  Let  ||x||^  =  1  ,  that  is  I  |x. |  =  1  .  Then, 


(5) 

k  .  Let  x  be 

I  I  Ax  |  I-,  =  I  |  a-k  |  . 


I |Ax| |  =  I  |I  a  x 

1  i  j  J 


<  I  I  |  a .  .  |  |  x  .  |  =  I  y  |  a .  .  |  |  x . 
"T  3  1J  J  ji  1J  J 


<  max  I  | a. . | 
-  j  i  1J 


Mow,  suppose  that  the  maximum  in  (5)  is  attained  for  j 
such  that  x.  =  0  ,  i  f  k  and  x^  =  1  .  Then, 


Hence  from  Theorem  (2), 


. 
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1 


max  | | Ax | |  =  max  £  |  a .  .  |  , 


ij 


x|  |=1  j  i 

which  establishes  (2).  To  prove  (3),  we  let  ||x|L  =  (x,x)  =  1  .  Then 


| | Ax | | 2  =  (Ax, Ax)  =  (x,A*Ax)  , 


and  from  the  Rayleigh's  principle  (see  Theorem  1:12:0(4),  we  conclude 
2 

that  | | Ax | | 2  is  the  largest  eigenvalue  of  the  positive  semidefinite 
matrix  A  A  .  Finally  since  A  A  and  AA  have  the  same  eigenvalues 
(see  Theorem  4:0(1)),  we  conclude  that 


2  2 

max  | | Ax |  L  =  a, 
x I  I =1  ^ 


'1 


Now  (3)  follows  from  Theorem  (2).  Finally,  to  prove  (4)  let 

| x | |  =  max  | x. |  =  1  .  Then, 

i  1 


=  max  T  a.  .  x .  1 

£  max 

l  |a..| 

1  X  •  1 

•  1 
i  j  J  J 

i 

3  1J 

1  J 

£  max 

l  |a- .  | 

• 

i 

3  1J 

Thus 


max  I  I  Ax | £  max  l  | a .  - 1  . 


ij 


(6) 


llx||=l  i  j 

Now,  let  the  maximum  on  the  right  in  (6)  be  attained  for  i  =  k  and 
consider  x  such  that  Xj  =  1  if  a^.  >_  0  and  Xj  =  -1  if  a^-  <  0  . 
Then 


I  I Ax|l  =  I  I  a 


kj 


and  (4)  follows  from  Theorem  (2). 


□ 


'»ij  3f 

T)  *  XA[! 


« 
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Remark  5.  The  ||A|L  is  also  called  the  spectral  norm. 


□ 


Definition  6.  A  matrix  norm  |  |  •  |  I  >  is  called  uni tarily  invariant  if, 
from  any  unitary  matrix  U  , 


□ 


Remark  7.  The  Euclidean  norm. 


A I 


=  l  | a- -|  ,  discussed  in  Chapter 

i,j  1J 

1:4  is  not  subordinate  to  any  vector  norm.  For,  in  case  of  a  subordinate 

matrix  norm,  by  definition,  the  norm  of  the  identity  matrix  is  one,  while 

1  /2 

the  Euclidean  norm  is  clearly  n  '  ,  where  n  is  the  order  of  the  identity 

matrix.  However,  it  is  compatible  with  the  Euclidean  vector  norm.  Finally, 
the  Euclidean  and  the  spectral  norms  are  unitarily  invariant,  while  the 
matrix  norms  induced  by  1  and  00  vector  norms  are  not.  □ 


The  following  result  is  given  in  [42]: 

Theorem  8.  For  any  subordinate  matrix  norm  ||«||  , 

P(A)  <  | |A| |  .  (7) 

Proof:  Let  X  be  any  eigenvalue  of  A  and  x  be  the  corresponding 
normalized  eigenvector.  Then, 

I  I  All  >  II  Ax  II  =  | | Ax | |  =  | X |  11x11  =  | X |  , 


which  completes  the  proof. 


□ 


— ■  ■ 

■lOfl 
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By  using  the  above  theorem  one  can  derive  bounds  for  the  spectral 

radius.  For  example  from  Theorem  (4),  we  obtain  p(A)  £  max  R.  ,  a  result 

i 

of  1:6:0. 


Given  a  normal  matrix  A  ,  a.  =  |A. |  ,  1  £  i  £  n  (see  Theorem 
4:1  (2)).  Thus,  for  a  normal  matrix  A  ,  equality  in  (7)  holds  for  the 
spectral  norm.  The  following  theorems  provide  the  necessary  and  sufficient 
conditions  for  equality  in  (7),  in  case  of  the  spectral  norm. 

Theorem  9.  Let  A  be  an  n><n  matrix  and  ||*||  be  the  spectral  norm. 
Then  p ( A)  =  |  |A| |  if  and  only  if  | |An| |  =  | |A| |n  . 

Proof:  See  [49] .  □ 


Theorem  10.  Let  A  be  an  nxn  matrix  and  M  be  the  spectral  norm. 


Then  p ( A)  =  ||A||  if  and  only  if 
of  the  form 


A  is  unitarily  similar  to  a  matrix 


where 


'A 


s+1 


B  =1 


.(b.  .) 
1J 


5 


O  *  I  I  I  I 

p(A)  I  -  B  B  is  positive  semidefinite,  and  s  is  such  that  |A^|  =  | A^ |  = 

|A  I  >  I A  , J  >  •••  >  |A  I ,  and  I  is  the  identity  matrix  of  order  n-s  . 
i  s 1  1  s+1 1  —  —  1  n 1 


Proof:  See  [14]. 


□ 


. 


X 
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§1:2 

In  this  section  we  shall  give  bounds  for  the  spectral  radius, 
which  are  not  included  in  Part  I. 

The  following  theorem  is  well-known: 

Theorem  1 .  Given  an  nxn  matrix  A  , 

p(A)  £  n  max  | a.  .  |  (1 ) 

i  »j  1J 

Further,  if  A  is  normal,  then 

max  |  a .  .  |  p(A)  .  (2) 

i  ,j  3 

Proof:  For  the  spectral  norm.  Theorem  1  (8)  gives,  p(A)  <_o- 1  .  Thus, 

p(A)^  £  tr  AA*  =  \  | a .  .  | ^  and  we  get  p(A)^  £  n^  max  |a.  .\^  ,  which 

i,j  1J  i  ,j  10 

proves  (1).  Since  for  normal  A  ,  p(A)  =  cr.j  ,  the  inequality  (2)  follows 
from  4:1(2).  □ 

Theorem  2.  Let  A  be  a  nxn  Hermitian  matrix.  Then 

II  a.  .|  /  n  £  p(A)  .  (3) 

i ,  j  J 

When  A  is  positive  semidefinite, 

P(A)  £  Un  ,  (4) 


where. 


■ 


•  -c.  • 

. 


■ 
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U,  =  a 


i  un 


uj 


bj 


=  2  tajj  +  uj-l  +'/(ajj'Uj-l)2  +  4  bj  1 


j-1 

■  I 
1=1 


a . 


TJ 


,  j  =  2,3, •• • ,n  and 


A-|  is  the  largest  eigenvalue  of  A 


Proof:  From  the  Rayleigh  principle  (see  Theorem  1:12:0  (3)), 


p ( A)  £  max  (x,Ax)  /  (x,x) 
x^O 

Thus,  choosing  x  =  (1,1, •••,!)'  ,  inequality  (3)  follows.  It  is  also 
proved  in  [23].  Inequality  (4)  is  proved  in  [52].  □ 


The  following  result  is  given  in  [5]: 

Theorem  3:  Let  A  be  a  positive  definite  matrix.  Then 

tr(Ak+'' )  /  tr(Ak)  £  p(A)  £  (tr(Ak)  ,  k  =  l,2,**«,n,***  .  (5) 


Proof:  Trivial.  □ 


Next,  we  give  some  results  for  nonnegative  matrices.  We  note 
that  for  any  matrix  A  if  |A|  =  (|a..|)  then  p( A)  £  p( | A | )  (see 
Theorem  1:10:0  (12)).  Thus  the  results  for  a  nonnegative  matrix  are  also 
applicable  to  an  arbitrary  complex  matrix. 


. 


J 


•  •  • « n  t  •* 


<})  -■■  '■  '  r  , 


.  •  - 
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We  shall  need  the  following  notation: 


(6) 

R  =  max  R.  and  r  =  min  R. 
i  1  i  1 

The  following  theorem  is  proved  in  [8]  and  [91. 

Theorem  4.  Let  A  be  an  nxn  nonnegative  irreducible  matrix.  Then  for 
n  >  2  , 


where 


min  M(i,j)  £  p(A)  £  max  M(i,j) 
i/j 


M(i  ,j)  =-J-{a..+a..+  [(a..-a..)^  + 
v  2  n  jj  n  33 


p/j]172 } 


(7) 


Also, 


1  ?  1/2 
max  «■  (a. .  +  a  . .  +  [(a.  .-a  . .)  +  4  a. -a  ..]  ;  }  <  p(A) 


1 i 


JJ 


n  JJ 


ij  Ji 


(8) 

□ 


The  inequalities  (9)  and  (10)  below  are  proved  in  [19]  and  [44], 
respectively. 

Theorem  5.  Let  A  be  an  n*n  irreducible  matrix.  For  fixed  j  let 


A .  .  =  Jr  {R.  -  a.  .  +  a  . .  +  [  ( R .  —a .  .-a  .  .)^  +  4 
ij  2  i  ij  jj  i  ij  jj' 


i  =  1 , 2 ,  •  •  • ,  n  ,  i  f  j  . 


Then : 


■ 
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min  A..  £  p(A)  £  max  A..  .  (9) 

W  1J  I7j  1J 

Further,  if  a  =  min  a..  >  °  =  |  R.j/n  anc*  k  is  the  least  of  the  positive 
off-diagonal  elements  of  A  ,  then: 


(n-1 )(1-e)r  + nea 
(n-1 ) (l-e )  +  ne  — 


p(A) 


„  (n-1 ) (l-e)R + nea 

-  (n-1 )(l-e)  +  ne 


(10) 


where  e  =  (k/  (R-a))n  ^  ,  so  that 


r  +  e(a-r)  £  p(A)  £R-e(R-a) 


□ 


It  is  shown  in  [36]  that  if  a  nonnegative  irreducible  matrix 
is  also  symmetric  then  the  lower  bound  for  p( A)  ,  given  by  (3)  is  better 
than  those  given  by  (7),  (9)  and  (10).  □ 


■ 


I 


' 


CHAPTER  2 


SPREAD 


§2:0  Prel iminaries. 

Given  an  nxn  matrix  A  ,  with  eigenvalues  *  »^n  >  the 

maximum  distance  between  the  eigenvalues  of  A  is  called  the  spread  of  A, 
that  is, 

sp(A)  =  max  |X.-X  .  |  (1 ) 

i  >j  10 

Also,  we  define 


and 


spR(A)  =  max  (Re(X. )  -  Re(X .) ) 
R  i,J  1  J 


spT(A)  =  max  (Im(X.)  -  Im(X.)) 
«!■  •  •  '  J 


(2) 

(3) 


Bounds  for  the  spread  are  given  under  the  heading  (d)  in  Part  I. 
Here,  we  shall  give  three  theorems  regarding  sp(A)  ,  spR(A)  and  spj(A) 
and  some  results  which  are  not  included  in  Part  I.  Unless  otherwise  stated, 
in  case  of  complex  eigenvalues  we  shall  assume  that  they  are  ordered  as: 

I I  ^  I ^2 1  —  *  *  *  —  I ^n I  5 

and  if  all  the  eigenvalues  are  real  then  they  are  ordered  as 

^1  —  ^2  —  *  *  *  —  ^n 

Thus,  if  A  is  Hermitian, 
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.1  ivA  #  if  ad;.  r*  vrp  mb  .>«9iGa  mi  'K  £  M  08 

- 


*1  I'  f  rfr-i •  ;.n  Jen  >  rord*  .  •  v  •  :  '  ■ 
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sp ( A)  =  spR(A)  =  X1  -  An  , 
and  sp j (A)  =  0  . 

The  following  two  theorems  are  given  in  [40]  and  [41]: 

Theorem  1 .  Let  A  be  a  normal  nxn  matrix.  Then 

sp ( A)  =  sup  | u  Au  -  v  Av I  , 
u,v 

_____  ★ 

sp(A)  >_  /3  sup  |  u  Av |  , 

u,v 

where  u  and  v  are  orthonormal  vectors.  Also, 

_  ^ 

SP  (A)  >  SUP  Sp  ( ZAy-Z~--)  . 

I Z | =1  Z 


(4) 


(5) 

(6) 

(7) 

□ 


When  A  is  Hermitian,  we  have  the  following: 

Theorem  2.  Let  A  be  a  nxn  Hermitian  matrix.  Then: 

sp(A)  =  2  sup  |u*Av|  ,  (8) 

u,v 

where  u  and  v  are  othonormal  vectors.  □ 


The  following  theorem  provides  an  upper  bound  for  spR(A)  and 

sPj(A)  : 

Theorem  3:  Let  A  be  an  nxn  matrix.  Then: 

sp ( A)  <  sp(B)  ,  (9) 

sPj(A)  <  sp(C)  , 


(10) 


•  •  r 


■ 


/ 


.X ne  I  rhdH  n*fr  6  eo*  A  -3:  I  .S  n^oartT 


, 
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where,  B  =  ^  (A+A  )  and  C  =  (A-A  )  .  Equality  holds  in  (9)  and  (10) 
if  A  is  normal. 

Proof:  Let  the  eigenvalues  of  B  and  C  be  y-|  _>  2L  ***  —  Vn  and 

V-|  >_  >_  •••  >_  vn  ,  respectively.  Then  from  Theorems  4:2  (1)  and  4:2  (2) 

we  have, 

max  Re (A.)  £  y,  ,  y<  min  Re (A.)  ,  (11) 

i  1  1  n  i  1 

max  Im(A. )  <  v,  and  v  <  min  Im(A.)  .  (12) 

Inequalities  (9)  and  (10)  follow  from  (11)  and  (12).  Also  from  Theorem 
11:0  (1),  equality  holds  in  (11)  and  (12)  for  normal  A  .  □ 


' 


■ 


. 
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§2:1 


Here  we  shall  give  bounds  for  sp(A)  ,  spR(A)  and  sp^(A)  of 


an  nxn  matrix  A  . 


Theorem  1 .  Let  A  be  a  nxn  Hermitian  matrix.  Then: 


2  max  | a .  .  |  £  sp(A)  ; 

w  J 


0) 


max  {(a. .-a..)2  +  4  la.-l2}1^2  <  sp ( A )  ; 

i7j  11  1J 


and 


y  max  (a.  .  +  a  .  .  +  [(a.  . -a  .  .)2  +  4 1 a .  ■  |2]  ^2}  - 

i^j 


2  vy  'n  33  L'  n  jj'  1  J 


(2) 


-  j  min  (a...  +  a^.  -  {(a^.-a^)2  +  4 1 a.^  1 2J  1/2>  <  sp(A)  . 

(3) 


Proof:  Inequalities  (1)  and  (2)  are  proved  in  [411.  Setting  u  =  e. 
and  v  =  e.  ,  i  f  j  in  Theorem  0  (2),  (1)  follows.  Further,  if  P  is 

si 

any  principal  submatrix  of  A  ,  then  from  the  Theorem  1:12:0  (5), 


sp(P)  <  sp(A)  . 

Thus,  choosing. 


inequality  (2)  follows.  Inequality  (3)  in  proved  in  [101.  □ 


.  A  xhfisra  n*n 


.  (A>q? 


' 
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Theorem  2.  Let  A  be  a  nxn  Hermit! an  matrix.  Define, 


ui  ~  Li  an 


Uj  =  2  [ajj  +  Uj-l +/,(ajj"Uj-l>2  +  4  V  > 


Lj 


=  1  [a  j  +  Lj.,  - ] 


j-1 

bj=  ^ 

J  i=l 


a .  . 
i  J 


j  =  2,3,* ••  ,n 


Then : 


SP(A>  iVLn 


w 


Proof:  It  is  proved  in  [52]  that  X,  <  U  and  X  >  L  .  Thus  (4) 
-  r  1  —  n  n  —  n  v  ' 

follows.  □ 


The  following  result  is  derived  in  [23].  It  provides  an  algor¬ 
ithm  for  calculating  the  lower  bound  for  the  spread  of  a  Hermitian  or 
normal  matrix.  It  is  particularly  good  for  a  nonnegative  symmetric  matrix 
(see  [23]). 


and, 


Let  I  and  J  be  non-empty  disjoint  subsets  of  {l,2,«**,n} 

K  =  {1 ,2 ,  —  ,n}  \  (IUJ)  . 


Let  s  and  t  denote  the  cardinality  of  I  and  J  ,  respecti vely .  Then 
we  have  the  following: 


.SWOtTot 


-U^'l  ana) 


' 
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Theorem  3.  If 


and  J  are  partitions  of  {l,2,«-«,n}  as  above,  then: 


if  A  is  normal,. 


1 

t 

rn 


I  a . .  -  —  y 

i,j£l  1J  S  i,j£J 
case  A  is  Hermitian 


5 


_L  sp(A)  , 


(5) 


2 

/st 


I  a., 
icl  1J 
jeJ 


sp  ( A )  . 


(6) 

n 


Theorem  4.  Let  A  be  a  normal  matrix  of  order  n  >_  3  .  Let  s-j  be 
the  trace  of  any  principal  minor  matrix  P  of  order  k  >_  3  of  A  and 
s^  the  sum  of  principal  minors  of  order  2  of  P  .  Then: 


sp(A)  >  i 


(£)  |(k-l)s12-2k  s2|1/2 


{J^T72]V2  Kk-Dsi2-2k  s2|1/2 


k  even  , 

(7) 

k  odd 


Proof:  See  [10], 


□ 


The  following  results  are  given  in  [40]  and  [41]: 
Theorem  5.  Let  A  be  an  nxn  normal  matrix.  Then: 


1/2  ,  , 

3  max  a .  . 

<  sp(A)  ; 

(8) 

max 

{ ( Re ( a i i ) 

-Reta^))2, 

|aij.  +  aj..|2}1/2  <  sp(A)  ; 

(9) 

max 

m 

{iaii-ajj 

I2  +  ( l a •  •  |  - 

1  "  ij1 

laji )2>^2  ~  sp(A)  ; 

(10) 

$  i-  / 


* 


•  xt'd&i!  fwnon  n«H  ns  9d.  A  JsJ  .  :  m-tpaifT 
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max  ( I  a .  .  |  +  |a  .  .  | )  <  sp(A)  ; 

i7j  J 

and 

max  (i  c  £  sp(A) 

i«  c  1J 

where , 


airaj/+4 


3  •  •  3  •  • 

1J 


+  2 1  a 


ij 


+  2 1  a 


Ji 


(ID 

(12) 


Proof:  Choosing  u  =  e.  and  v  =  e.  ,  i  f  j  in  0  (6),  (8)  follows. 

•  J 

From  0  (7)  and  (2),  with  |z|  =1  ,  we  have  for  i  f  j  , 


(sp(A))2  £  {Re(ail-z)  -  Re(aj.j.z)2}2  +  |ai jZ  +  a^.zl2  .  (13) 

Choosing  z  =  1  ,  we  obtain  (9).  Also  (13)  implies 

(sp(A))2  >  [Re{(aii-aj.j.)z>]2  +  ( la^-l-la^.  |  )2  .  (14) 


Also,  since 


su^  [Re{(aii-ajj)z}]2  -  la^-a^l2 


inequality  (14)  yields  (10).  Again,  from  (13), 


sp(A)  >  sup  |a..z  +  a..z|  =  |a..|  +  |a.,|  , 

| 2 | =1  1 J  J  1 J  J 


which  proves  (11).  For  the  proof  of  (12)  see  [41]. 


□ 


t.  rr 
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Given  A  ,  upper  bounds  for  spR(A)  and  spj(A)  can  be 

obtained  using  Theorem  0  (3)  and  any  upper  bound  for  the  spread  of  a  Hermi- 

tain  matrix.  In  particular,  Theorem  (2)  provides  upper  bounds  for  spR(A) 

1 


when  a.j  is  replaced  by  b..  .  =  y  (a.  . +  8.^)  and  for  spj(A)  when  a^ 
is  replaced  by  c.  ■  =  A-  (a.  a  . . )  .  Similarly,  for  normal  A  ,  Theorem 
0  (3)  can  also  provide  lower  bounds  for  spR  (A)  and  spj(A)  . 


CHAPTER  3 


GERSCHGORIN  DISKS 


§3:0  Prel iminaries. 


Given  an  nxn  matrix 


where  x.  >0  ,  let 


A 


. (x)  =  (  T  | a .  . 
1  '.3.  1  13 


Then  the  Gerschgorin  disk  G. (x) 


A  =  (a.  .)  and  X(x)  =  di ag (x-j  ,x2>* •  •  ,xn) 


xj-)/xi  ,  i  =  1 , 2 ,  •  •  • ,  n  .  (1) 

in  the  complex  plane  is  defined  by. 


G^x)  =  (z  :  Iz-a^.  |  <  Aq.  (x)}  ,  i  =  l,2,***,n  .  (2) 

Considering  the  matrix  X  "*AX  ,  it  follows  from  the  Gerschgorin' s  Theorem 
(see  1:6:2)  that  each  eigenvalue  of  A  lies  in  at  least  one  of  the 
disks  G.j(x)  ,  1  <_  i  <_  n  .  Thus,  the  Gerschgorin  set, 

G(X)  =  U  G  (x)  ,  (3) 

•  I 


contains  all  the  eigenvalues  of  A  .  Further,  if  A  is  irreducible, 
an  eigenvalue  of  A  is  boundary  point  of  the  union  of  the  Gerschgorin 
disks  only  if  it  is  the  boundary  point  of  all  the  disks.  For,  if  X  is 
an  eigenvalue  of  A  such  that  -|A-a..  |  >_  A.  (x)  ,  i  =  l,2,*#*,n  ,  then  it 
follows  from  1:6:2  (-TO),  that  equality  must  hold  in  all  of  the  above 
inequalities,  as  det(AI-A)  =  0  . 


k 

Also,  from  Gerschgorin's  Theorem  (see  1:6:2)  if  U 

k 1=1 

point  in  common  with  the  remaining  (n-k)  disks,  then  U  G. 

i=l  1 


G.  has  no 
contai ns 
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Jsf  t  0  <  9"isrlw 


>  { j.  r i5-x  :  xJ  *  (x)  .9 


* 


rjnsi.  l32'l*3  srtt  ,iU(lT 


fx-- 
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exactly  k  eigenvalues  of  A  .  If  fact,  using  continuity  arguments  one  can 
prove  the  following  (see  e.g.  [241): 

Theorem  1 .  Let  be  any  subset  containing  s  elements  of  J  =  {l,2,***,n} 
and  define  S(x)  =  u  G.(x)  and  T(x)  =  u  G.(x)  .  If 

js  j/js 

S(x)  n  T(x)  =  9G( x)  ,  (4) 

where  9G(x)  is  the  boundary  of  G(x)  ,  then  S(x)  contains  exactly  s 
eigenvalues  of  A  .  □ 

Now  let 

dkj  =  lakk'ajjl  >  1  —  ^  >  j  — n  • 

Then  we  have  the  following: 

Definition  2.  Let  P^  be  the  set  of  all  positive  vectors  x  such  that 

dkj  =  I akk"aj j I  1  Aj(x)  + Ak(x)  all  j  t  k  .  (5) 

If  is  non-empty  then  we  say  that  the  matrix  A  admits,  under  diag¬ 
onal  similarity  transformations,  an  isolated  kth  Gerschgorin  disk.  In 
case  there  exists  a  set  Js  ,  Js  c  {l,2,*#,,n}  such  that  Js  has  s 
elements  and  there  exists  x  >  0  such  that  (5)  holds  for  all  k  e  S 
and  j  €  {l,2,***,n>  /  Js  ,  we  say  that  the  s  disks,  Js  are  isolated. 

n 


. 

9^6  „l  c2izrb  z  jfiftj  $w  ,  zl  V  fn;-**,S, 0  »  t 
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Now  we  show  that  if  any  s  given  disks  are  isolated  as  defined 

above  then  they  contain  exactly  s  eigenvalues  of  A  .  Without  loss  of 

k 

generality  we  let  u  G. (x)  be  isolated.  Then  from  the  definition,  for 

i=l  1 

any  Z  <_  k  and  k  <  m  <  n  ,  there  exists  a  vector  x  >  0  such  that 


a£jTamm 


iVx)+Am(x)  • 


k 


n 


Further,  let  S(x)  =  u  G-(x)  and  T(x)  =  u  G.(x).. 

i=l  1  k+1  1 

is  empty  then,  from  Theorem  (1)  the  result  follows.  Let 
We  need  to  show  that  z  is  a  boundary  point. 


(6) 

If  S ( x )  n  G(x) 
z  £  S(x)  n  T(x)  . 


Now,  z  £  S(x)  n  T(x)  ,  implies  there  exists  Z  ,  1  <  £  <  k 
and  m  ,  k  <  m  <  n  such  that 


z-a«  liA*  and  |z-aJ<Am 


(7) 


If  possible,  let  equality  not  hold  in  one  of  the  inequalities  in  (7),  Then 


d£m  ' a££~amnv  -  'z”aM'  +  '  z“amnr 


<  A  +  A 

m 


-  d£m 


which  is  a  contradiction.  Therefore  Iz-a.J  =  An  and  z-a  I  =  A 

1  ZZ 1  Z  mm  m 

k 

Hence  z  is  a  boundary  point  and  from  Theorem  (1)  u  G.  contains 

i=l  1 

exactly  k  eigenvalues. 


Naturally,  in  order  to  obtain  bounds  using  Gerschgorin  disks, 
if  possible  one  would  like  to  have  isolated  disks.  This  is  one  of  the 


.  . 


■  ■ 


V 
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reasons  that 
the  disks  - 
isolated  but 
in  case 
like  to  find 


the  matrix  X  ^AX  is  considered  instead  of  A  to  obtain 
it  might  happen  that  no  disk  of  the  matrix  A  (X=  I  )  is 
some  disks  of  X~^AX  are,  for  some  choice  of  X  .  Secondly 
is  non-empty,  that  is,  the  kth  disk  is  isolated,  one  would 
the  disk,  with  smallest  possible  radius  u  , 


y  =  inf  Ak(x) 
xePk 


In  the  next  section  we  briefly  address  the  above  mentioned, 
two  questions  and  in  section  2  we  consider  the  case-when  A  is  real. 


*  cl 
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§3:1 

In  this  section  first  we  shall  give  results  which  provide  suffi¬ 
cient  conditions  under  which  G^(x)  can  or  cannot  be  isolated  by  some 
matrix  X  =  diag(xi ,X£,  . . . ,x  )  ,  x.  >  0  ,  1  <  i  <  n  .  These  conditions  are 
also  necessary  for  certain  class  of  matrices.  As  we  shall  see,  in  case 
the  conditions  for  isolation  are  satisfied  then  X(x)  is  readily  deter¬ 
mined.  All  these  results  are  proved  in  [481.  We  shall  omit  their  proofs. 

We  shall  consider  the  problem  of  isolating  the  kth  disk  only. 
Theorem  1 .  Given  an  nxn  matrix  A  ,  let 


Mi 


max 

j7i 


and 


ij 


*k = 


min 

j7k 


kj 


=  min 
j7  k 


Q  •  |  “*  cl  •  • 

kk  jj 


>  0 


(1) 


M, 


fk(t)  - 


Mk+t 


l 

j7k 


M. 

JL 


M  .  +  d.  . 
3  kj 


-  t 


(2) 


Then,  G^(x)  can  be  isolated  by  some  X(x)  ,  and  strict  inequality  holds 
in  0  (5)  ,  if  f,  (s)  <  1  for  some  s  ,  0  <  s  <  t,  . 


Proof:  See  [481 . 


□ 


Theorem  2.  Let  the  hypotheses  of  the  above  theorem  be  satisfied.  If 

M.  =  0  ,  for  all  j  ,  1  <  j  <  n  then  X ( x )  =  I  isolates  G,  ,  with 
J  n  k 

strict  inequality  in  0  (5).  If  M.  f  0  for  some  j's  let  M.  , 

J  Jq 

q  =  l,2,***,£  be  non-zero  (il<n),  and  define 


5  •  /  \ 

J-,  (s) 

Jq 


5 


3 


q  =  2 ,  •  •  •  ,il 


3 


.  •  rC 


. 
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a 


Xjq  "  n+l-Jt 


,  q  =  £+1 , • • •  ,n 


where,  a  =  6 .  (s) 
J1 


l 


l  x.  ,  and 
q=l  Jq 


M.  +  s 

6.  (s)  = 
kv  '  M, 


M .  +  d,  .  -  s 

¥s>  ■  -V1- 


»  j  f  k  . 


Then  X(x)  =  diag(x^ jX^,*** ,xn)  isolates  Gb  ,  with  strict  inequality 


in  0  (5) . 


Proof:  See  [48] . 


□ 


Theorem  3.  Let  m. 


min  I  a..  |  >0  and  t.  be  given  by  (1) 
2  -Z  Z  *  J  K 


Define 


J>i 


m.  m . 

k 


m  +t  +  ^  m  +d^  -t 

K  mk  t  j?!k  m j  akj.  t 


If  g^(t)  >_  1  for  all  t  ,  0  £  t  <_  t^  ,  then  no  X  isolates  G^(x)  , 

with  strict  inequality  in  0  (5). 


Proof:  See  [48] . 


□ 


Theorem  4.  Let  A  be  such  that  |  a^ .  |  =  for  all  j  f  k  ,  k  =  l,2,«**,n 
Further,  let  t^  and  f^  be  given  by  (1)  and  (2),  respectively.  Then 
G^(x)  can  be  isolated  with  strict  inequality  in  0  (5)  by  some  X(x)  if 
and  only  if  f^(s)  <  1  for  some  s  ,  0  <  s  <  t^  . 


Proof:  See  [48] . 


□ 


/ 
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Next,  we  give  a  convergent  algorithm  which,  given  an  isolated 
kth  disk,  finds  the  smallest  disk  G^(x)  ,  with  radius  y  , 


y  =  inf  G,  (x) 
xepk 


where  is  as  given  by  definition  0  (2).  This  result  is  proved  in  [60]. 

Its  proof  involves  the  theory  of  M -matrices.  We  shall  state  it  without 
proof. 

Without  loss  of  generality  we  can  assume  that  A  is  irreducible. 

Further  if  the  kth  Gerschgorin  disk  is  isolated,  that  is,  is  non-empty, 

we  can  assume  that  k  =  1  (this  can  always  be  done  by  the  use  of  a  suitable 

permutation  matrix)  so  that  G,  is  isolated.  Finally,  as  A.(hx)  =  h  A.(x) 

J  J 

for  h  >  0  and  1  £  j  £  n  ,  we  let  x-|  =  1  ,  for  all  x  e  P-|  . 

If  Q  =  (q.  .)  is  a  real  matrix,  such  that 

'  vJ 


i  =  1,2, •••,(! 


qlj  =  >aljl  ’  2U'  1" 


i  t  J  ,  i  t  1 


Then  clearly  A  irreducible  implies  that  Q  is  irreducible.  Further,  we 
partition  Q  as. 


5 


-/  *tf  St:  «  n  ;  t  2  f 
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<v 

where  Q  is  the  principal  submatrix  of  Q  of  order  (n-1)  , 

a'  =  ( |a12| ,  |  a-j  3 1  ,  •••  ,|a1n|)  and  a'  =  ( I  a2]  I » I  a3i  I ,  *•*  >lanlD  *  Let 

A 

y  be  the  vector  with  (n-1)  components  obtained  from  the  column  vector 
y  =  (yn- )  »  by  deleting  y-j  .  Conversely  given  y  let  y  =  (y. )  denote 
the  unique  column  vector  such  that  y-|  =  1  ,  y  .+^  =  y.  ,  i  =  1 ,2,-«* ,n-l  . 
Then  we  have  the  following: 

Theorem  5.  Let  A  be  an  irreducible  matrix  of  order  n  ,  which  admits  a 
first  isolated  disk,  G-j(x)  .  Then  the  smallest  radius  y  , 

y  =  inf  A-.  (x)  , 

XeP-j 

for  this  isolated  disk  is  an  eigenvalue  of  the  matrix  Q  and  its  corres¬ 
ponding  eigenvector  y^  is  uniquely  determined  in  P-j  .  If  xQ  e  P-j 
and  Q  xq  _>  A-|(xq)xo  ,  with  strict  inequality  in  at  least  one  component, 
then  the  sequence  of  vectors  {x. }  defined  by 

(Q  A1(xi)In_1)  xi+1  =  a  ,  i  >  0  , 

are  all  elements  of  P,  with  lim  x.  =  y  ,  and  the  sequence  {A.  (x.))n-_n 

■j  -XX)  ^ 

is  strictly  decreasing  with  lim  A-j(x. )  =  y  . 

■j  -xxi 

Proof:  See  [60] .  □ 

It  is  shown  in  [34],  that  the  above  algorithm  can  be  used  to 
directly  estimate  the  isolated  eigenvalue  of  A  ,  rather  than  just  obtain¬ 
ing  the  Gerschgorin  disk  of  smallest  possible  radii.  Also  in  [35]  the 
above  algorithm  is  extended  to  the  case  when  more  than  one  isolated  disks 


- 


6  ■  or-  : 


:  fj-  ■ 


>  ■  j  toio  r  L 


.  • 


' 


\ 
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are  given.  Finally,  in  [24]  an  algorithm  is  given  which  does  not  depend 
on  a  prior  knowledge  that  a  given  set  of  disks  is  isolated. 
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§3:2 

In  this  section  we  shall  give  some  results  for  a  real  matrix. 

The  following  result  is  well-known  (see  e.g.  [57,  pg.  287]): 

Theorem  1 .  Let  A  be  a  real  matrix.  If  the  Gerschgorin  disk  G^(x)  , 

1  £  k  £  n  ,  has  no  point  in  common  with  the  remaining  (n-1)  disks  (or 

strict  inequality  holds  in  0  (5))  then  A  has  a  real  eigenvalue  of  multi¬ 
plicity  one. 

Proof:  From  Gerschgorin's  Theorem  (see  1:6:2), G^  has  exactly  one  eigen¬ 
value,  say  X  .  In  case  A  is  complex,  since  A  is  real,  we  conclude 
that  A  is  also  an  eigenvalue  of  A  .  Now  A  and  A  lie  symmetrical ly 
about  the  real  axis  (since  a^  is  real)  and  we  have  that  both  A  and  X 
belong  to  G^(x)  ,  which  is  a  contradiction.  Thus  A  must  be  real. 

The  following  result  is  immediate  from  the  above  theorem: 

Theorem  2.  Let  A  be  a  real  matrix.  If  A  has  k  Gerschgorin  disks 

which  have  no  point  in  common  with  any  other  disk,  then  A  has  k 

real  distinct  eigenvalues.  □ 

The  following  theorem  is  proved  in  [48]: 

Theorem  3.  Let  A  be  a  real  matrix  and  a  subset  of  {l,2,---,n} 

with  n  elements.  If  the  ith  Gerschgorin  disk  of  ^AX.  is  isolated 

with  strict  inequality  in  0  (5),  for  all  i  e  ,  then  A  has  at  least 
k  real  distinct  eigenvalues.  □ 


.  .  r-;)  .  . -.f>  .'•■r  JVC.  , 
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CHAPTER  4 


SINGULAR  VALUES 


§4:0  Prel iminaries. 

In  this  chapter  we  shall  discuss  the  relationships  among  the 

"k  “I 

eigenvalues  of  AA  (square  of  singular  values),  j  (A+A  )  (real  singular 
values),  jj-  (A-A  )  (imaginary  singular  values)  and  A  ,  where  A  is  an 
nxn  complex  matrix.  We  shall  also  include  bounds  for  the  singular  bounds 
for  the  singular  values,  which  are  not  included  in  Part  I.  Unless  other¬ 
wise  stated  we  shall  assume  that  the  eigenvalues  of  A  are  ordered  as 


if  complex  and  as 


if  real . 

As  (AA  )  =  AA  we  conclude  that  AA  is  Hermitian.  In  fact, 

AA  is  positive  semidefini te,  since  for  any  vector  x  (AA  x,x)  = 

k  k  k 

(A  x,A  x)  >  0  .  Thus,  the  eigenvalues  of  AA  are  nonnegative.  Further- 

k 

more,  it  follows,  from  Theorem  (1)  below,  that  AA  is  positive  definite  if 

"k 

and  only  if  A  is  nonsingular.  Similarly,  A  A  is  positive  semi definite 

k  k 

Actually,  AA  and  A  A  have  the  same  eigenvalues: 

•k  ■ k 

Theorem  1 .  Matrices  AA  and  A  A  have  the  same  eigenvalues. 

Proof:  Since  A  is  nxn  the  proof  follows  immediately  from  the  fact  that 
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if  H  and  K  are  matrices  of  order  mxn  and  nxm  respectively  (m<_n) 
then  the  eigenvalues  of  KH  are  the.  m  eigenvalues  of  HK  and  zero, 
repeated  n-m  times  (see  [39,  pg.  200]).  □ 

2  2  2 

Definition  2.  If  a-j  >_  >_  Gn  are  the  nonnegative  ordered 

★ 

eigenvalues  of  AA  then  _>  >_  •  •  •  >_  an  are  called  the  singular 

values  of  A  .  □ 

Remark  3.  If  A  is  rectangular  of  order  mxn  (m<_n)  then  A  has  m 
singular  values.  However,  we  shall  generally  consider  only  square  matrices. 
Analogous  results  will  hold  for  rectangular  matrices.  □ 

Now  we  state  the  Singular  value  decomposition  theorem.  The 
proof  can  be  found  in  [42,  pg.  330]. 

Theorem  4.  If  A  is  an  mxn  (m£n)  matrix,  then  there  exist  unitary 
matrices  U  ,  mxm  and  V  ,  nxn  such  that 

A  =  U  D  V  (1) 

where  D  =  diag^  jC^s*** »am)  is  mxn  and  a-j  _>  •••  CTm  are  the 
singular  values  of  A  .  Further,  if  the  rank  of  A  is  k  then  exactly 
k  singular  values  are  positive.  □ 

Next  define, 


B  =  j  ( A+A* )  and  C  =  jr-  (A-A*) 


(2) 


Clearly  B  and  C  are  Hermitian.  Given  A  ,  it  can  be  decomposed  as 


r 


.  ' 

V-U.,- V  b Tod  rfh.  ,  <furM  aucooP  >A  9 


■■ 
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A  =  B  +  iC  .  It  can  be  shown  that  this  Hermitian  decomposition  is  unique. 


Definition  5.  The  eigenvalues  of  B  =  (b..  •) 
the  real  and  imagainary  singular  values  of 


and  C  =  (c .  . ) 

U 

A  ,  respecti vely. 


are  called 

□ 


Remark  6.  B  and  C  will  always  be  assumed  to  be  defined  by  (2).  Also, 
it  will  be  assumed  that 


y-j  1  ^2  -  *  *  *  - 

yn 

and  v-j 

—  v2  —  *  *  *  —  vn 

(3) 

are  the  ordered  eigenvalues 

of 

B  and  C 

• 

□ 

Remark  7.  If  A  is  Hermiti 

an , 

then  B  = 

A  and  C  =  0  ,  while  if 

A  i  s 

skew-Hermitian  then  B  =  0 

and 

C  =  A  . 

□ 

Remark  8.  It  follows  from  the  definition  of  B  and  C  that, 

tr  B^  =  (tr  AA  +Re(tr  A^))  and  tr  ^  (tr  AA  -Re(tr  A^))  .  (4) 

□ 


r.  •_  -  '• :  •  ’  - 
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§4:1  Singular  Values  and  Eigenvalues. 

We  shall  now  study  the  relationship  between  the  singular  values 
and  the  eigenvalues  of  a  matrix  A  . 

Theorem  1 .  For  any  square  n><n  matrix  A  : 

k  k 

n  I  A.  I  <  n  a.  ,  k  =  l,2,#,,,n  ,  (1) 

1  1  1  1 

with  equality  for  k  =  n  ; 


(2) 


I  lxn*  |S  1  I  aiS  >  s  >  0  ,  k  =  1 ,2,***,n  .  (3) 

1  1  1  1 


Equality  holds  in  (1)  for  k  =  l,2,***,n  if  and  only  if  equality  holds  in 
(3)  for  k  =  l,2,»**,n  if  and  only  if  A  is  normal.. 


Proof:  To  establish  (.2),  we  have,  using  the  Rayleigh  quotient,  that 

*  2  * 

(AA  x,x)  >_  an  ,  for  any  x  such  that  x  x  =  1  .  Thus,  if  x  is  a  nor¬ 
malized  eigenvector  of  An  ,  we  obtain 


°nZ  1  (AA  x’x)  =  (A  X>A  x)  =  (xn  x,Anx) 


,  ,2  ,  s  ,2 

xnl  (x,x)  =  |Xn| 


hence  (2)  follows.  For  the  proof  of  (1)  and  (3)  see  [31,  pg.  115]. 
Equality  conditions  follow  from  the  theorem  below.  □ 

The  following  result  is  well-known  (e.g.  see  [16]). 


' 


^  ■ 
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Theorem  2.  Given  A  ,  it  is  normal  if  and  only  if, 

a .  =  IX. I  ,  i  =  1 , 2 ,  •  •  • ,  n 

l  1  i  1 


(4) 


Proof:  Let  A  be  normal.  Then  there  exists  a  unitary  matrix  U  such 

that  A  =  UDU  ,  D  =  diagC^ • ,An)  .  Therefore  AA  =  UDDU  and, 

using  the  fact  that  similar  metrices  have  the  same  eigenvalues,  (4) 

follows.  Conversely,  let  (4)  hold.  Then  from  Schur's  triangularization 

theorem,  there  exists  a  unitary  matrix  U  and  an  upper  triangular  matrix 

*  *  * 


T  such  that 
conclude  that 


AA  =  UTT  U  and  t..  =  X.  ,  i  =  l,2,*«*,n  .  Thus,  we 

•k  ~k 

AA  and  TT  have  the  same  eigenvalues  and. 


?°i2- W  .1 


i7k 


t 

i  k 


From  which  we  conclude  that  T  is  diagonal.  Hence  A  is  normal.  □ 


The  following  result  is  immediate  from  the  above  theorem: 
Corollary  3.  If  A  is  positive  semi  definite  then: 


i  =  1,2, 


,n 


5 


(5) 

□ 
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§4:2  The  Matrices  A,  B  and  C. 

In  this  section  we  shall  establish  relationships  between  the 
eigenvalues  (A..  ' s)  of  A  and  the  eigenvalues  (y.  's  and  v.  's)  of  B 
and  C  respectively.  In  particular,  we  shall  see  that  the  real  (imagi¬ 
nary)  singular  values  of  A  ,  majorize  the  real  (imaginary)  parts,  Re(A-) 

( Im(A.j ) )  of  A  . 

Theorem  1 .  Let  the  eigenvalues  and  real  singular  values  of  A  be  A.,  and 
y.  ,  i  =  l,2,*«*,n  ,  respectively.  Let  Re(A^)  >_  Re(A2)  >_  •••  >_  Re(An)  and 

y-j  1^2  —  —  yn  *  "*"*ien: 


Re(A1 )  £  P1  ;  (1 ) 

Rn  1  Re(An)  ;  (2) 

k  k 

l  Re(  A. )  <  l  y.  ,  k  =  l,2,***,n  ,  (3) 

1  1  1  1 

with  equality  in  (3)  for  k  =  n  . 

Proof:  Assertions  (1)  and  (2)  follows  from  the  Rayleigh  quotient.  For 
if  x  is  an  eigenvector  corresponding  to  the  eigenvalue  A  of  A  , 

then  y  <_  Re  (A)  =  (Bx,x)  £  y. j  .  For  the  proof  of  (3)  see  [32,  pg.  2371  . 

□ 

As  one  would  expect,  similar  relations  hold  between  the  imaginary 


parts  of  the  eigenvalues  of  A  and  the  imaginary  singular  values  of  A  : 
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Theorem  2.  Let  the  eigenvalues  and  imaginary  singular  values  of  A  be 
arranged  so  that  Im(X^)  >_  Im(X2)  >_•••>_  Im(Xn)  and  >_  v2  >_  •  •  •  >_  vn  . 
Then  we  have  the  following: 

Im(X-| )  <  ;  (4) 

vn  1  Im(xn)  ;  (5) 

k  k 

l  Im(X.)  <  l  v.  ,  k  =  1 ,2 , • •  •  ,n  ,  (6) 

1  1  1  1 

with  equality  for  k  =  n  .  □ 

The  following  result  relating  the  eigenvalues  of  A  ,  B  and  C 
is  given  in  [16]: 

Theorem  3.  Given  a  matrix  A  ,  then  Re(X.)  ,  i  =  l,2,***,n  are  the  eigen¬ 
values  of  B  if  and  only  if  Im(X.)  ,  i  =  l,2,***,n  are  the  eigenvalues 
of  C  ,  if  and  only  if  A  is  normal.  □ 


< 


J 


' 
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§4:3  The  Matrices  AA*,  B  and  C. 

The  following  three  theorems  exhibit  the  relationships  among  the 
three  types  of  singular  values  (see  e.g.  [1]). 

Theorem  1 .  If  a.  ,  y.  ,  v.  ,  i  =  l,2,***,n  are  the  singular,  real  singu¬ 
lar,  and  imaginary  singular  values  of  A  ,  respectively,  then: 

tr  B2  +  tr  C2  =  l  y.2  +  l  v.2  =  l  a.2  =  tr  AA*  .  (1) 

i  1  i  1  i  1 

Proof:  The  result  follows  from  expanding 

2  21  ,*21  ,*2 
tr  Is  +  tr  C  -  tr  (A+A  y  -  j  tr  (A-A  y  , 

*•  -k 

and  using  the  fact  that  tr  AA  =  tr  A  A  and  that  B  and  C  are  Hermitian. 

□ 


Theorem  2.  For  any  nxn  matrix  A  : 


vi 

<  a . 

—  i 

i  =  1  »2 , • • •  ,n 

(2) 

V. 

i 

<0.  , 

—  i 

i  =  1 ,2,*«*,n 

(3) 

Proof: 

The  inequality  (2)  is 

proved  in 

[1 3] .  If  we  repl  ace  A 

by  -iA  , 

then  the 

o.  ,  i  =  1 ,2,"«  ,n  , 

are  unchanged  but  the  real  singular 

val ues 

of  -iA 

are  v.  ,  i  = 1 ,2,*«* 

,n  .  Thus 

(3)  follows  from  (2). 

□ 

Wi  gxe  mO'rt  awo  f  f  crt  3  f 9ffl 
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Theorem  3.  If  A  is  normal,  then: 


2  2  2 
cr-,  <  max  u.  +  max  v  . 

I  •  I  •  1 


2  2  2 
a  >  min  u.  +  min  v. 
n  •  1  •  i 


Proof:  From  Theorems  1  (2)  and  2  (3)  we  have 


2  .2  2  ,  2  ,  2  2  2 

°1  =  |Xll  =  uj  +  vk  and  °n  *  +  vm  > 

for  some  1  £  j,k,£,m  £m  .  Thus,  taking  the  maximum  and  minimum  of 
and  \k2  ,  i  =  l,2,***,n  ,  (4)  and  (5)  follow. 


(4) 

(5) 


i 
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§4:4  Bounds  for  Singular  Values. 

Bounds  for  the  singular  values,  >_  >.  •  •  •  >_  ap  ,  are  given 

2 

under  the  heading  (g)  in  the  chapters  of  Part  I.  Also,  since  a.  , 

■k 

i  sl,2,*",n  are  the  eigenvalues  of  the  positive  semidefinite  matrix  AA  , 
we  can  apply  the  corresponding  results  from  Chapter  13  in  Part  I.  Below, 
we  give  results  which  are  not  included  in  Part  I  (we  attempt  to  maintain 
the  same  ordering  of  the  information  as  used  in  Part  I). 

(a)  For  a-j  : 

Theorem  1 .  Given  A  , 

2  2  _  2 

max  [a..  |  <  max  £  |a..|  <  max  II  a . .  a ..  |  <_  cr,  ;  (1) 

i  ,j  1J  i  j  J  1  ,  j  k  1K  JK  1 
■,  t  s 

max  -  |  7  y  a.  .  |  <  a,  ,  1  <  s  ,  t  <  n-1  .  (2) 

s,t  At  j=l  i=l  1J  ~ *  1 2 

Proof:  The  first  two  inequalities  in  (1)  are  clear.  To  prove  the  inequal- 

it  it 

it y  on  the  right-hand  side  of  (1)  we  consider  AA  .  Since  AA  is  posi- 

2 

tive  semidefinite,  its  eigenvalues  a.  ,  i  =l,2,*--,n  are  also  its 

singular  values  (see  Corollary  1  (3)).  Thus,  choosing  t-j  =  1  ,  t^  =  t^  = 

•••  =  t  =0  in  Theorem  (7)  below,  we  obtain  a,  >  u  AA  v  ,  where 
n  1  — 

|  |u| |  =  | |v| |  =  1  .  Therefore  with  u  =  e.  and  v  =  e.  ,  (1 )  follows. 

*  vJ 

This  result  is  also  proved  in  [47].  To  prove  (2),  once  again  Theorem  (7) 

it 

implies  o ^  >  u  Av  with  ||u||  =  ||v||  =1  .  Choosing  u  =  (u^)  and 
v  =  (v. )  such  that  u^  =  1  /  /s  ,  i  =  1 ,2, • • •  ,s  ,  u-  =  0  for  i  >  s  , 
u.  =  1  /St  ,  i  =  l,2,***,t  and  v^  =  0  for  i  >  t  ,  (2)  follows.  We  note 


1 


nr  i  j*y  •  V  91 


■  r- 


. 


that  u  and  v  could  be  choosen  differently,  to  obtain  bounds  different 


from  ( 1 ) 


Theorem 


where  B 

(b) 

Theorem 
a  set  of 

Then: 

where 


and  (2). 


The  following  result  is  given  in  [7,  pg.  67]: 


l.  For  real  A  , 


o1  <  max  T  I b .  .  I  +  max  7  I c .  .  I  , 

1  -  1  4  1  U1  1  $  id1 

=  ( b i j }  ~  \  (A+A' )  and  C  =  (c.j)  =  (A-A1 )  . 


□ 


(3) 

□ 


For  a  : 
n 

An  interesting  lower  bound  for  an  is  given  in  [22]: 

Let  A  be  an  mxn  (n<_m)  matrix  and  s  =  •  •  ,sn>  be 

positive  column  scaling  weights  such  that 


min 

j 


m 


I 

i=l 


(4) 


w .  •  =  max(0  ,  | a .  .  I  s  . 
WU  1  J 


i 

k^j 


1  *  i 

i  k 


Sk} 


(5) 

□ 


We  can  modify  the  above  theorem  in  the  case  of  a  normal  matrix 


J 


(w  >  n)  n*m  nc  »d  A  teJ  .e  msiosrfT 


. 
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Theorem  4.  If  A  is  normal  and  are  positive  numbers  such 

that 

l  *,2  - 1  • 


Then : 


2  2  2 
min  T  p .  .  +  min  T  q .  .  <  a  , 

j  i  1J  j  1  1J  ~  n 


(6) 


where 


pij  =  ">ax(0,l  |aij+a..|  Sj-^  l»1k+akil  sk>  • 


(7) 


and, 


q..  max(0,2  !  ai  j“aji  I  sj  '  \  J,  '  aik"aki '  sk)  ’  1  ,J’  1  >2,*  •  •  ,n.  (8) 


J 


3  (5)  we 

have 

and  min 

lvil 

i 

.  •  and 
l  J 

q .  • 

we 


and  (8)  respectively.  Then,  applying  Theorem  (3)  to  B  and  C  ,  we  have, 


2  ..  .  v  _  2  ,  ,  ..  2  .  .  r  .  2 


min  u/  >  min  l  p.  .  and  min  v.  >  min  l  q.. 

—  4  ,•  I  J  I  —  4  4  I  J 


J  1 


3  1 


Thus,  we  get 


2  2  2 
a  >  min  l  p.  .  +  min  l  q. . 

n  j  i  1J  j  i  1J 


which  completes  the  proof. 


□ 


■ 
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The  following  lower  bound  for  an  is  given  in  [7,  pg.  67]: 


Theorem  5.  For  real  A  , 


mi 


inda^l  -  l  lbikl)  -  max  l  lcikl 


where 


,  B  =  j  (A+A1)  and  C  =  (A-A')  . 


(9) 

□ 


The  following  upper  bound  for  an  is  well-known, 


Theorem  6.  Given  A  , 


r  <  min  (Y  |a..|^)"^  <  min  7  la.. 
i  J  J  i  j  J 


(10) 


2  *  *  i  i  i  i 

Proof:  From  the  Rayleigh  quotient  an  <_  x  AA  x  ,  |  | x |  |  =  1  .  Hence 
choosing  x  =  e.  ,  (10)  follows.  □ 

(e)  For  sum  of  singular  values: 

The  following  theorem  provides  an  algorithm  for  obtaining  lower 
bounds  of  nonnegative  linear  combinations  of  singular  values  of  A  .  The 
proof  is  similar  to  the  one  used  in  Theorem  6  of  [41],  for  obtaining  the 
bounds  for  the  spread  of  a  matrix. 


Theorem  7.  If  t-j  >_  t^  >_  •  •  •  >_  tn  >_  0  ,  then: 
k  k  * 

l  t.  a.  -  sup  l  t.  |u.  A  v. |  ,  k  =  1 ,2 , • • •  ,n  ,  (11) 

•  1  I  I  .  ,  •  n  i  I  ! 

1=1  ui,vi  1=^ 


/ 


m 


!'i<  '  <  to*  n  dfnoJ  T&srjr  t  sv  r j  tspennon  zbruod 
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where  u  •  and 

v  j  ,  i  =  1 , 2 ,  •  - 

•,n  are 

two  sets  of  orthonormal 

vectors. 

In  particular: 

k 

k 

l  |a.. 
i  11 

<  y  a. 

1  1 

,  k  -  1 ,2,*** ,n  , 

02) 

k 

k 

1  |a. 
1-1  1 

n-1+4  - 

.  I  cy.  ,  k  =  1 ,2, •  •  •  ,n 

1  1 

(13) 

Proof:  Let  the  moduli  of  the  diagonal  elements  of  A  be  denoted  by 
d-j  >_  d2  >_  •••  _>  dn  .  Then  from  1:2:0  (7), 


k  k 

I  di  £  l  a.  ,  k  =  1 ,2,* • •  ,n 

1  1  1 

and  we  have 

k  k 

^Wl^  |  di  -  ^Wl^  |  ai  9  k  =  1 ,2,  • • •  »n-l  , 


Adding  the  above  set  of  inequalities  yields 


T  t.  d.  <  Y  t. 
4  l  1—4  1 


ai 


(14) 


Now,  let  U  =  [ulsu2,...,un]  and  V  =  [v-j  ,v2,«»*,vn]  be  unitary  matrices 
with  columns  u^  and  v^  ,  respectively.  Then  the  matrix  UAV  has  the 
same  singular  values  as  A  .  Thus,  if  we  order  u^  ,  v.  ,  i  =  l,2,*«*,n 

^  c^, 

such  that  |  u-j  A  v-|  |  >_  |  u2  A  I  >.  •  •  •  >.  I  un  ^  vn  I  »  ^rom  0  4) ,  we  obtai  n 


■ 


9  Sri  cfafi 


- 


-  '  i 
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Hence, 


cr. 

l 


> 


sup  l  t. 

ui,vi 

i=l ,2,* • • ,n 


u*Avi 


(15) 


Further,  equality  in  (15)  is  attained  for  U  and  V  such  that 

diagCa-j  ,•••  ,an)  =UAV  .  Thus  (11)  follows.  With  t-j  =  t^  =  ••  •  =  t^  =  1  , 

t^  =  ...  =  tn  =  0  ,  inequality  (12)  follows  by  choosing  u^  =  v.  =  e.  , 

i  =  2,  •••,  k,  while  (13)  follows  by  choosing  u.  =  e.  and  v.  =  e  .  , 

i  i  i  n-i  +  i , 

i  =  1 ,  2 ,  •  •  • ,  k .  □ 

Below  we  present  another  lower  bound  for  the  partial  sums  of 
singular  values. 


Theorem  8.  Let  •  denote  any  kxk  submatrix  of  A  obtained  by  deleting 
(n-k)  rows  and  (n-k)  columns  of  A  ,  and  let  t.  be  the  sum  of  the 


absolute  values  of  the  elements  of  A.  .  Then: 


max  it.  £  ?  a.  ,  k  =  1 ,2,***  ,n-l  .  (16) 

k  k  k  1  i 


Proof:  By  the  Singular  value  decomposition  theorem,  there  exist  kxk 
unitary  matrices  U  and  V  such  that  A^  =  U D V  ,  where 
D  =  diag(a-| ',*•••, cr^1 )  and  a.1  ,i  =  l,2,«**,k  are  the  singular  values 
of  A^  .  Thus, 


k  k  k 

a  =  J  u  cr'v  ,  i.e.  t,<  J  a'  T  |u 
pq  £  pm  m  mq  k  ~  m=l  m  p=l 


pm 


k 

l  |v 

q=l 


mq 


p=l 


pm 


1  k  k  2  k  2 

which  implies,  y  t.  £  l  a  '  ,  since  (  l  |u  |)  <k  y  |u  |  =  k  and 

n  k  ^  m  p_1  pm 

<  l  lvmqD2ik  • 

q=l  H 


V 


■ 


\ 
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Lastly,  as  a. 1  ,  i  =  l,2,*«*,k  are  the  singular  values  of  , 
k  k 

we  have  £  a.1  <  J  a.  (see  [55]).  This  completes  the  proof  of  (16). 
i=l  1  1  1 


Finally,  we  give  a  lower  bound  for  the  partial  sums  of  the 
squares  of  the  singular  values: 


Theorem  9.  Let  s.  ,  i  =  l,2,***,n  be  the  squared  sums  l  |a.  . 

j 

in  decreasing  order.  Then 

k  k  o 

I  s.  <  I  o.  ,  k  =  l,2,---,n  . 

i=l  1  i=l  1 


,  arranged 

(17) 


Equality  holds  for  k  =  n  . 


Proof:  The  inequality  (17)  follows  at  once  by  applying  the  fact  that 
eigenvalues  of  a  Hermitian  matrix  majorize  the  diagonal  elements,  to  the 
matrix  AA  .  □ 


' 

n  8  J  .  zb  fori  y3rf£<>p3 


) 


. 

. 
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i 4 : 5  Bounds  for  Real  and  Imaginary  Singular  Values. 


Since  B  and  C  are  Hermitian,  the  bounds  given  in  Chapter 


I  :  12  are  applicable  to  B  and  C  (with  a.  .  replaced  by 

*  J 


b..  =  j  (a.  .  +  a..)  for  B  and  by  c.  . 
*  J  ^  1  J  J  ^  '  J 


_  1 


One 


2l  CaTj  for  C)’ 

may  also  use  Theorem  2  (3)  if  A  is  normal  and  Remark  0  (7)  if  A  is 

Hermitian.  □ 


CHAPTER  5 


CONDITION  NUMBER 


§5:0  Prel iminaries. 

Consider  the  linear  system 

Ax  =  b  ,  (1 ) 

where,  A  is  an  nxn  nonsingular  matrix  and  x  and  b  are  n*l 
vectors.  Then  (1)  has  a  unique  solution, 

x  =  A-1  b  .  (2) 


We  shall  now  see  how  the  solution  (2)  is  affected  by  pertubations  in  the 
right-hand  side  of  (1)  and  in  the  elments  of  the  matrix  A  .  Suppose 
that  in  (1)  the  vector  b  is  perturbed  to  b+6b  ,  and  that  the  exact 
solution  of  the  perturbed  system  is  x+6x  ,  that  is. 


A(x+6x)  =  b  +  6b  . 


Therefore, 

x  +  6x  =  A  1 (b  +  6b) 


Using  (2) ,  we  obtain, 


6x  =  A"1  6b  . 


Thus,  for  any  compatible  matrix  norm,  | |*| 

I  I 6x| I  <  I IA"1 II  I  1 6b 


(3) 


218 


* 
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A1 so  from  (1 ) , 


Combining  (3)  and  (4),  we  have. 


1  1 6x [  1 
llxll  - 


x 


■1,.  I  1 6b  II 
I  I  b  |  | 


(4) 


(5) 


Similarly,  if  A  is  perturbed  by  6A  and  6x  is  the  corresponding  change 
in  the  solution  vector  x  ,  then 


which  gives, 


or 


(A+6A)(x+6x)  =  b 


6x  =  -A 

[  |6x|  |  <  MA'1! 

II  xll  . 

I  I  x+Sx  I  |  — 


6A(x+6x)  and 
||6A||  | | x+6x | |  , 

I lA"1 | |  ||6A||  . 


Considering  the  change  ||5A||  relative  to  | |A| |  ,  we  get 


I16x| | 

I  I x+6x I  I  — 


1 1  A| I  I  I  A-1 1  | 


I  I 6A|  | 

I  I A I  I 


(6) 


Thus,  both  in  (5)  and  (6),  the  relative  change  in  the  exact 
solution  is  bounded  by  the  number  ||A||  ||A~'*||  multiplied  by  the  rela¬ 
tive  perturbation  in  the  data.  The  number  |  |A|  |  ||A~"'||  is  called  the 


condition  number  of  A  .  We  shall  denote  it  by  c(A)  . 


' 


/ 
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The  condition  number  of  A  indicates  the  maximum  effect  of 
perturbations  in  b  or  A  on  the  exact  solution  of  (1).  From  (5)  and 
(6)  we  see  that  if  c(A)  is  large,  then  the  change  in  the  exact  solution 
of  (1)  may  be  large,  even  for  small  perturbations  in  b  or  A  .  Given  a 
nonsingular  matrix  A  ,  it  is  called  ill-conditioned  if  c(A)  is  large 
and  wel 1 -condi tioned  if  c(A)  is  small. 

Note  that  i  f  for  any  matri  x  norm  |  |  •  |  |  ,  |  1 1 1  |  >_  1  ,  then 

1  <  |  1 1|  |  <  | | A | |  | | A-1 | |  =  c(A)  . 

In  particular,  for  any  subordinate  matrix  norm  and  the  Frobenius  norm, 

c(A)  >  1  .  (7) 

Further,  for  the  spectral  norm, 

c(A)  =  ^-  >  1  .  (8) 

n 

It  follows  from  the  Singular  value  decomposition  theorem  (see  Theorem 
4:0  (4))  that  equality  holds  in  (8)  if  and  only  if  A  =  cU  ,  for  some 
unitary  U  and  scalar  c  .  Finally,  we  give  the  following  result: 

Theorem  1 .  Let  A  be  a  nonsingular  matrix.  Then  for  any  subordinate 
matrix  norm,  |  |  •  |  I  » 

max  IX. |  n 

i  1  .  |Ai 

min  l^-l  |Xn 


'  c ( A )  =  | ] A | |  | | A-1 


'  >/.:  Zt :  ■  *  -i  i 


r 


■ 
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Proof:  From  Theorem  1:1  (8),  we  have  that,  max  |X. |  <_  ||A||  .  Further 

l 

since  the  eigenvalues  of  A""*  are  A.  ^  ,  i  =  l,2,«**,n  ,  we  again  have 


max  |X. 


-1 


1 


mi  n  |  a  • 


1  I  I A 


-1 


which  completes  the  proof. 


□ 


11:5:1 
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§  5:1 


Bounds  for  the  condition  number  are  given  in  Part  I  under  the 
heading  (h),  for  the  spectral  norm.  However,  in  view  of  Theorem  0  (1)  a 
lower  bound  for  the  condition  number  which  is  obtained  by  using  the  ine¬ 
quality 


Ail  cr, 

TTic(A) 

n  n 


» 


is  actually  a  lower  bound  for  any  condition  number  defined  by  using  a 
subordinate  norm.  Below  we  give  a  lower  bound  for  the  condition  number 
and  a  technique  for  estimating  it. 


The  following  result  is  given  in  [27,  pg.  29]. 


Theorem  1 .  Let  A  be  a  nonsingular,  triangular  matrix.  Then  for  the 
spectral  norm, 


max  | a .  .  | 

j  ,.j _ 

min  | a . .  | 

•  i  I 

i 


1  c(A)  . 


0) 


Proof:  It  follows  from  Theorem  11:4:4  (1)  that 

as  A  is  triangular,  the  diagonal  elements  of 

i  =  l,2,***,n  and  its  largest  singular  value  is 

la.. I  ^  <  o  1  and  now  (1)  follows. 

1  n  '  —  n 


max  a .  .  <  cr, 

i.j  1J 

A""*  are  a .  ^ 
an  ^  .  Thus, 


Also, 


□ 


Given  a  nonsingular  matrix,  | |A| |  (where  11*11  is  1,2  or  00 
norm)  can  be  easily  calculated.  The  following  technique  for  estimating 
|  | A""*  ||  is  given  in  [11]  : 


. 

\v  1 


i(  ij  »  »  J  0!  V  <1  f  .  i  '■  *"»■;  r-7 


. 
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Theorem  2.  Let  A  be  nonsingular.  Let  x  and  y  be  two  vectors  such 
that 


A'x  =  b 


Ay  =  x 


(2) 


where  each  component  of  b  is  choosen  to  be  +1  or  -1  so  that  the 
solution  x  is  as  large  as  possible.  Then, 

r  =  | |y| |  /  | I x | |  ,  (3) 


provides  an  estimate  for 


□ 


An  algorithm  is  given  in  [11],  which  employes  the  QR  or  the 
LU  decomposition  of  A  to  calculate  | |A  Mi  •  It  involves  0(n  ) 
operations,  once  the  decomposition  is  known.  Also,  it  is  shown  experi¬ 
mentally,  that  this  technique  provides  a  reliable  indication  of  the  order 
of  the  magnitude  of  condition  number.  This  technique  is  implemented  in 
LINPACK,  a  collection  of  FORTRAN  subroutines  for  solving  various  forms  of 
linear  equations.  In  [43]  it  is  shown  that  the  estimate  r  given  by  (3) 
is  norm  dependent.  Further  in  case  the  LU  decomposition  of  A  is  known, 

r1  =  max(  |  [y  |  |  -,  /  |  | x  |  |  -,  ,  |  |x|  |J  , 

where  x  and  y  are  given  by  (2),  is  shown  to  give  a  better  estimate  of 
| |A_1 M1  for  matrices  of  small  order.  Another  technique  is  given  in  [18] 
for  estimating  |  | A  M  i  • 


.  ;  .'i  p.'  i  ■ 


1 


BIBLIOGRAPHY 


[1]  Amir-Moez,  A.  R.,  and  Fass,  A.L.;  Elements  of  Linear  Spaces,  Pergamon 

Press,  Oxford,  1962. 

[2]  Bailey,  D.W.,  and  Crabtree,  D.E.;  Bounds  for  Determinants,  Linear 

Algebra  and  Appl .  2,  303-309  (1969). 

[3]  Beesach,  P.R.;  The  Spread  of  Matrices  and  Polynomials,  Linear  Algebra 

and  Appl.  31 ,  145-149  (1980). 

[4]  Bellman,  R.;  Introduction  to  Matrix  Analysis,  2nd  ed.,  McGraw  Hill, 

1970. 

[5]  Bellman,  R.;  The  Largest  and  the  Smallest  Characteristic  Roots  of  a 

Positive  Definite  Matrix,  Jour,  of  Math.  Ana.  and  Applications 
90,  217-208  (1982). 

[61  Berman,  A.,  and  Plemmons,  R.J.;  Nonnegative  Matrices  in  the  Mathemat¬ 
ical  Sciences,  Academic  Press,  1979. 

[71  Bodewig,  E.;  Matrix  Calculus,  Interscience  Publishers,  1956. 

[81  Brauer,  A.,  and  Gentry,  I.C.;  Bounds  for  the  Greatest  Characteristic 
Root  of  an  Irreducible  Nonnegative  Matrix,  Linear  Algebra  and 
Appl.  8,  105-107  (1974). 

[9]  Brauer,  A.,  and  Gentry,  I.C.;  Bounds  for  the  Greatest  Characteristic 
Root  of  an  Irreducible  Nonnegative  Matrix  II,  Linear  Algebra 
and  Appl.  13,  109-114  (1976). 

[10]  Brauer,  A.,  and  Mewborn,  A.C.;  The  Greatest  Distance  Between  Two 

Characteristic  Roots  of  a  Matrix,  Duke  Math.  26,  653-661  (1959). 

[Ill  Cline,  A.K.,  Moler,  C.B.,  Stewart,  G.W.,  and  Wilkinson,  J.H.;  An 
estimate  for  the  condition  number  of  a  matrix,  SIAM  J.  Numer. 
Anal.  16,  368-375  (1979). 

[12]  Drazin,  M.P.,  and  Haynsworth,  E.;  Criteria  for  the  reality  of  a  matrix 
eigenvalue.  Math.  Zeitschr.  78,  449-452  (1962). 

224 


. 


. 


. 


.(4W)  Tor-eor  ,8  .raqA 


.  • 


■ 


9I1»  10^  fifnornS  « .3  friMow«n*6H  bnfi  .ntxAiO  [ST] 


[13]  Fan,  K. ,  and  Hoffman,  A.J.;  Some  metric  inequalities  in  space  of 

matrices,  Proc.  Amer.  Math.  Soc.  6,  111-116  (1955). 

[14]  Goldberg,  M,  and  Zwas,  G.;  On  Matrices  Having  Equal  Spectral  Radius 

and  Spectral  Norm,  Linear  Algebra  and  Appl .  8,  427-434  (1974). 

[15]  Graybill,  F.A.;  Matrices  with  Applications  in  Statistics,  2nd  ed., 

Wadsworth  Publishing  Co.,  1983. 

[16]  Grone,  R.,  Johnson,  C.R.,  Sd,  E.M.,  and  Wolkowicz,  H.;  Normal 

Matrices,  Linear  Algebra  and  Appl.,  to  appear. 

[17]  Grone,  R.,  Johnson,  C.R.,  Sa,  E.M.,  and  Wolkowicz,  H.;  Improving 

Hadamerd's  Inequality,  Linear  Algebra  and  Appl.,  to  appear. 

[18]  Hager,  W.W.;  Condition  Estimates,  SIAM  J.  Sci .  Stat.  Comput.,  to 

appear. 

[19]  Hall,  C.A.,  and  Porsching,  T.A.;  Bounds  for  the  Maximal  Eigenvalue 

of  a  Nonnegative  Irreducible  Matrix,  Duke  Math.  36,  159-164 
(1969). 

[20]  Henri ci,  P.;  Bounds  for  iterates,  inverses,  spectral  variation  and 

fields  of  values  of  non-normal  matrices,  Numer.  Math.  4,  24- 
40  (1962). 

[21]  Holladay,  J.C.,  and  Varga,  R.S.;  On  powers  of  non-negative  matrices, 

Proc.  Amer.  Math.  Soc.  9,  631-634  (1958). 

[22J  Jennings,  A.;  Bounds  for  the  Singular  Values  of  a  Matrix,  IMA  Jour, 
of  Numerical  Analysis  2,  459-474  (1980). 

[23]  Johnson,  C.R.,  Kumar,  R.,  and  Wolkowicz,  H.;  Lower  Bounds  for  the 

Spread  of  a  Matrix,  Submitted. 

[24]  Johnston,  R.L.,  and  Smith,  B.T.;  Calculation  of  Best  Isolated  Gersch- 

gorin  Discs,  Numer.  Math.  16,  22-31  (1970). 

[25]  Kress,  R.,  Vries,  M.L.,  and  Wegmann,  R.;  On  Nonnormal  Matrices, 

Linear  Algebra  and  Appl.  8,  109-120  (1974). 


225 


,  -  f';  v.; 


" 

.  1  ■  ■  ■  ,  ’ 


■  Si 


■  .  .  ' '  •  o  ••  •  .oc-  ?c 


no'rjiifwDfftO  ;.T.8  ,(tfirac  bna  .noiandoC  f£S] 


[26]  Lancaster,  P.;  Theory  of  Matrices,  Academic  Press,  1969. 

[27]  Lawson,  C.L.,  and  Hanson,  R.J.;  Solving  Least  Squares  Problems, 

Prentice-Hall,  1974. 

[28]  Liqun  Qi ;  Some  Simple  Estimates  for  Singular  Values  of  a  Matrix, 

Linear  Algebra  and  Appl .  56,  105-119  (1984). 

[29]  Marcus,  M.;  An  Inequality  Connecting  the  P-condition  Number  and  the 

Determinant,  Numer.  Math.  4,  350-353  (1962). 

[30]  Marcus,  M.;  Lengths  of  Tensors  in  Inequalities  I,  0.  Shisha  ed.. 

Academic  Press,  1979. 

[31]  Marcus,  M. ,  and  Mine,  H.;  A  Survey  of  Matrix  Theory  and  Matrix  In¬ 

equalities,  Allyn  and  Bacon,  Boston,  1964. 

[32]  Marshall,  A.W.,  and  01  kin,  I.;  Inequalities:  Theory  of  Majorization 

and  its  Applications,  Academic  Press,  1979. 

[33]  Medley,  H.I.;  A  Note  on  a  Paper  of  Johnston  and  Smith's  Concerning 

Best  Isolated  Gerschgorin  Disks,  Numer.  Math.  16,  435-441  (1971). 

[34]  Medley,  H.I.,  and  Varga,  R.S.;  On  Smallest  Isolated  Gerschgorin 

Disks  for  Eigenvalues  II,  Numer.  Math.  11,  320-323  (1968). 

[35]  Medley,  H.I.,  and  Varga,  R.S.;  On  Smallest  Isolated  Gershgorin  Disks 

for  Eigenvalues  III,  Numer.  Math.  11,  361-369  (1968). 

[36J  Merikoski,  J.K.;  On  a  Lower  Bound  for  the  Perron  Eigenvalue  ,  BIT 
19,  39-42  (1979). 

[37]  Merikoski,  J.K. ,  Styan,  G.P.H.,  and  Wolkowicz,  H.;  Bounds  for  Ratios 
of  Eigenvalues  Using  Traces,  Linear  Algebra  and  Appl.  55,  105- 
124  (1983). 

[381  Merikoski,  J.K.,  and  Wolkowicz,  H.;  Improving  Eigenvalue  Bounds  Using 
Extra  Bounds,  Linear  Algebra  and  Appl.,  to  appear. 

[391  Mirsky,  L.;  An  Introduction  to  Linear  Algebra,  Oxford  Univ.  Press, 
1955. 


226 


9  l:\  ,  -  •  ;■  t 


"  't*  vj  j<>  A  ;  .:•  ,  r-.  ,  io  .  M  .Z':  :  i:  '■ 


-J 


'  W.  •. 


nr -<?'  frit  tc  ■  bnuoS  iswoJ  .*  nO  ,  ^zc  \  M  [dCj 


l  ■  S'i  J  ff&y.r- 


[40]  Mirsky,  L.;  The  Spread  of  a  Matrix,  Mathematika  3,  127-130  (1956). 

[41]  Mirsky,  L.;  Inequalities  for  Normal  and  Hermitian  Matrices,  Duke 

Math.  24,  591-599  (1957). 

[42]  Noble,  B.;  Applied  Linear  Algebra,  Prentice-Hall,  1969. 

[43]  O'Leary,  D.P.;  Estimating  Matrix  Condition  Numbers,  SIAM  J.  Sci . 

Stat.  Comput.  1,  205-209  (1980). 

[44]  Ostrowski,  A.,  and  Schneider,  M.;  Bounds  for  the  Maximal  Characteris¬ 

tic  Root  of  a  Mon-negative  Irreducible  Matrix,  Duke  Math.  27, 
547-553  (1960). 

[45]  Parker,  W.V.;  The  Characteristic  Roots  of  Matrices,  Duke  Math.  12, 

519-526  (1945). 

[461  Parker,  W.V.;  Characteristic  Roots  and  the  Field  of  Values  of  a 
Matrix,. Duke  Math.  15,  439-442  (1948). 

[471  Parker,  W.V.;  Sets  of  Complex  Numbers  Associated  with  a  Matrix,  Duke 
Math.  15,  711-715  (1948). 

[48]  Porsching,  T.A.;  Diagonal  Similarity  Transformations  which  Isolate 
Gerschgorin  Discs,  Numer.  Math.  8,  437-443  (1966). 

[491  Ptak,  V.;  Norms  and  the  spectral  radius  of  matrices,  Czech  Math.  J. 
12,  555-557  (1962). 

[50]  Schneider,  H.;  An  Inequality  for  Latent  Roots  Applied  to  Determinants 

with  Dominant  Principal  Diagonal,  J.  London  Math.  Soc.  28,  8-20 
(1953). 

[51]  Seneta,  E.;  Non-negative  Matrices,  An  Introduction  to  Theory  and 

Applications,  John  Wiley,  1973. 

152]  Slepian,  D.,  and  Landau,  H.;  A  Note  on  the  Eigenvalues  of  Hermitian 
Matrices,  SIAM  J.  Math.  Anal.  9,  291-297  (1978). 

[53J  Stone,  B.J.;  Best  possible  ratios  of  certain  matrix  norms,  Numer. 
Math.  4,  114-116  (1962). 


227 


' 


:■  •  ■  ,J  *r.'  ■  ;  .  -  ■  t'  '.-V 


\ 


ii  M  r  J  r  j  9’  . 


[54]  Taussky,  0.;  On  a  Recurring  Theorem  on  Determinants,  Amer.  Math.  Soc. 

56,  672-676  (1949). 

[55]  Thompson,  R.C.;  Principal  Submatrices  IX:  Interlacing  Inequalities 

for  Singular  Values  of  Submatrices,  Linear  Algebra  and  Appl .  5, 
1-12  (1972). 

[56]  Thompson,  R.C.;  Singular  Values,  Diagonal  Elements,  and  Convexity, 

SIAM  J.  Appl.  Math.  32,  39-63  (1977). 

[57]  Todd,  John;  Survey  of  Numerical  Analysis,  McGraw-Hill,  1962. 

[58]  Tood,  John;  On  Smallest  Isolated  Gerschgorin  Disks  for  Eigenvalues, 

Numer.  Math.  7,  171-175  (1965). 

[59]  Varga,  R.S.;  Matrix  Iterative  Analysis,  Prentice-Hall,  1962. 

[60]  Varga,  R.S.;  On  Smallest  Isolated  Gerschgorin  Disks  for  Eigenvalues, 

Numer.  Math.  6,  366-374  (1964). 

161]  Wilkinson,  J.H.;  The  Algebraic  Eigenvalue  Problem,  Oxford  Univ. 

Press,  1965. 

[62]  Wolkowicz,  H.;  Generating  Eigenvalue  Bounds  Using  Optimization, 

Research  Report,  Uni  verity  of  Alberta. 

[63]  Wolkowicz,  H.,  and  Styan,  G.P.H.;  Bounds  for  Eigenvalues  Using 

Traces,  Linear  Algebra  and  Appl.  29,  471-506  (1980). 

[64]  Wolkowicz,  H.,  and  Styan,  G.P.H.;  More  Bounds  for  Eigenvalues  Using 

Traces,  Linear  Algebra  and  Appl  .  31,  1-17  (1980). 


228 


.  c  f  '  .  T 


/ 


•  ■■■  "  ’  '  *  >  ■  0  ' 

.(OSGF)  Vf-F  ,TE  .  fqqA  boe  a-uIs^A  ’f8«35rtT  ■ 


